Apr 28 02:10:07 devstack cinder-volume[71767]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 28 02:10:07 devstack cinder-volume[71767]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 28 02:10:07 devstack cinder-volume[71767]: we strongly recommend against using it for new projects.
Apr 28 02:10:07 devstack cinder-volume[71767]: If you are already using Eventlet, we recommend migrating to a different
Apr 28 02:10:07 devstack cinder-volume[71767]: framework.  For more detail see
Apr 28 02:10:07 devstack cinder-volume[71767]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 28 02:10:07 devstack cinder-volume[71767]:   import eventlet  # noqa
Apr 28 02:10:09 devstack cinder-volume[71767]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=71767) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 02:10:09 devstack cinder-volume[71767]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=71767) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 02:10:09 devstack cinder-volume[71767]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=71767) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 02:10:10 devstack cinder-volume[71767]: INFO dbcounter [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Registered counter for database cinder
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_db.sqlalchemy.engines [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71767) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG dbcounter [-] [71767] Writer thread running {{(pid=71767) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 28 02:10:10 devstack cinder-volume[71767]: INFO cinder.rpc [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 28 02:10:10 devstack cinder-volume[71767]: INFO cinder.rpc [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_db.sqlalchemy.engines [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71767) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 02:10:10 devstack cinder-volume[71767]: INFO cinder.volume.manager [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Determined volume DB was empty at startup.
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG cinder.volume.manager [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=71767) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 28 02:10:10 devstack cinder-volume[71767]: INFO cinder.volume.manager [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 28 02:10:10 devstack cinder-volume[71767]: WARNING stevedore.named [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 28 02:10:10 devstack cinder-volume[71767]: WARNING castellan.key_manager [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 02:10:10 devstack cinder-volume[71767]: WARNING cinder.keymgr.conf_key_mgr [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG cinder.volume.drivers.lvm [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=71767) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_concurrency.processutils [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=71767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_concurrency.processutils [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] CMD "cinder-rtstool verify" returned: 0 in 0.247s {{(pid=71767) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_db.sqlalchemy.engines [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71767) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 02:10:10 devstack cinder-volume[71767]: INFO cinder.rpc [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 28 02:10:10 devstack cinder-volume[71767]: INFO cinder.rpc [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 28 02:10:10 devstack cinder-volume[71767]: WARNING stevedore.named [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 28 02:10:10 devstack cinder-volume[71767]: WARNING castellan.key_manager [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 02:10:10 devstack cinder-volume[71767]: INFO cinder.volume.manager [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_db.sqlalchemy.engines [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71767) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 02:10:10 devstack cinder-volume[71767]: INFO oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Starting 1 workers
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Started child 71872 {{(pid=71767) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Full set of CONF: {{(pid=71767) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] ******************************************************************************** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Configuration options gathered from: {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] ================================================================================ {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] allow_availability_zone_fallback = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] allow_compression_on_image_upload = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] allowed_direct_url_schemes     = [] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] api_rate_limit                 = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] auth_strategy                  = keystone {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] az_cache_duration              = 3600 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_availability_zone      = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_host                   = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_name                   = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_stats_polling_interval = 60 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backup_api_class               = cinder.backup.api.API {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backup_name_template           = backup-%s {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backup_use_same_host           = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backup_use_temp_snapshot       = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] chap_password                  = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] chap_username                  =  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cinder_internal_tenant_project_id = 5cd267741f9f4f0b9b226b32048ed709 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cinder_internal_tenant_user_id = 748e81f417654c5496df0fc86c3e19db {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cloned_volume_same_az          = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cluster                        = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] compression_format             = gzip {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] compute_api_class              = cinder.compute.nova.API {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] config_dir                     = [] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] config_source                  = [] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71872]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] control_exchange               = openstack {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] debug                          = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] default_availability_zone      = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] default_group_type             = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] default_volume_type            = lvmdriver-1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] disk_geometry                  = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] driver_client_cert             = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] driver_client_cert_key         = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] driver_data_namespace          = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] driver_ssl_cert_path           = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] driver_ssl_cert_verify         = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] driver_use_ssl                 = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] enable_force_upload            = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] enable_new_services            = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] enable_unsupported_driver      = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] enforce_multipath_for_image_xfer = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] filter_function                = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance_api_insecure            = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance_api_servers             = ['http://192.168.122.192/image'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance_api_ssl_compression     = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance_ca_certificates_file    = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance_catalog_info            = image:glance:publicURL {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance_certfile                = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance_keyfile                 = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance_num_retries             = 3 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance_request_timeout         = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] goodness_function              = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] graceful_shutdown_timeout      = 5 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] group_api_class                = cinder.group.api.API {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] host                           = devstack {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] image_compress_on_upload       = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] image_conversion_address_space_limit = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] image_conversion_cpu_limit     = 60 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] image_conversion_disable       = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] image_upload_use_cinder_backend = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] image_upload_use_internal_tenant = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] image_volume_cache_enabled     = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] image_volume_cache_max_count   = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] image_volume_cache_max_size_gb = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] init_host_max_objects_retrieval = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] iscsi_target_flags             =  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] iscsi_write_cache              = on {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] iser_helper                    = tgtadm {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] iser_ip_address                = 192.168.122.192 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] iser_port                      = 3260 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] log_color                      = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] log_config_append              = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] log_dir                        = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] log_file                       = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] log_options                    = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] log_rotate_interval            = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] log_rotate_interval_type       = days {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] log_rotation_type              = none {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] max_age                        = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] max_logfile_count              = 30 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] max_logfile_size_mb            = 200 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] max_over_subscription_ratio    = 20.0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] message_reap_interval          = 86400 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] message_ttl                    = 2592000 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] migration_create_volume_timeout_secs = 300 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] monkey_patch                   = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] monkey_patch_modules           = [] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] my_ip                          = 192.168.122.192 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] no_snapshot_gb_quota           = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] num_iser_scan_tries            = 3 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] num_shell_tries                = 3 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] num_volume_device_scan_tries   = 3 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] nvmeof_conn_info_version       = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] nvmet_ns_id                    = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] nvmet_port_id                  = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] osapi_max_limit                = 1000 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] osapi_volume_ext_list          = [] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] osapi_volume_listen_port       = 8776 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] osapi_volume_use_ssl           = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] osapi_volume_workers           = 2 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] per_volume_size_limit          = -1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] periodic_fuzzy_delay           = 60 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] periodic_interval              = 60 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] public_endpoint                = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] publish_errors                 = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] quota_backup_gigabytes         = 1000 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] quota_backups                  = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] quota_gigabytes                = 1000 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] quota_groups                   = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] quota_snapshots                = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] quota_volumes                  = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] rate_limit_burst               = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] rate_limit_except_level        = CRITICAL {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] rate_limit_interval            = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] reinit_driver_count            = 3 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] replication_device             = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] report_discard_supported       = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] report_interval                = 120 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] reservation_clean_interval     = 86400 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] reservation_expire             = 86400 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] reserved_image_namespaces      = [] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] reserved_percentage            = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] rpc_response_timeout           = 120 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] run_external_periodic_tasks    = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] scst_target_driver             = iscsi {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] scst_target_iqn_name           = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] service_down_time              = 720 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] shell_completion               = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] snapshot_name_template         = snapshot-%s {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] snapshot_same_host             = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] split_loggers                  = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] state_path                     = /opt/stack/data/cinder {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] storage_availability_zone      = nova {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] storage_protocol               = iSCSI {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] syslog_log_facility            = LOG_USER {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] target_helper                  = lioadm {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] target_ip_address              = 192.168.122.192 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] target_port                    = 3260 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] target_protocol                = iscsi {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] target_secondary_ip_addresses  = [] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] trace_flags                    = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] transport_url                  = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] until_refresh                  = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] use_chap_auth                  = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] use_default_quota_class        = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] use_journal                    = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] use_json                       = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] use_multipath_for_image_xfer   = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] use_stderr                     = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] use_syslog                     = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] verify_glance_signatures       = enabled {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] volume_api_class               = cinder.volume.api.API {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] volume_backend_name            = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] volume_clear                   = zero {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] volume_clear_ionice            = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] volume_clear_size              = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] volume_copy_bps_limit          = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] volume_dd_blocksize            = 1M {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] volume_name_template           = volume-%s {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] volume_service_inithost_offload = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] volume_usage_audit_period      = month {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] zoning_mode                    = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_concurrency.disable_process_locking = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.admin_password = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.admin_token = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.admin_user  = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.auth_port   = 35357 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.auth_protocol = https {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.auth_section = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.auth_type   = password {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.auth_uri    = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.auth_version = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.cache       = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.certfile    = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.delay_auth_decision = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71872]: INFO cinder.volume.manager [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.http_connect_timeout = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.identity_uri = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.include_service_catalog = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.insecure    = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.interface   = public {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.keyfile     = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_password =  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcache_username =  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.region_name = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.service_token_roles_required = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.service_type = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.token_cache_time = 300 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.192/identity {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.backend                  = dogpile.cache.null {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.backend_argument         = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.backend_expiration_time  = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.config_prefix            = cache.oslo {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.debug_cache_backend      = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.enable_retry_client      = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.enable_socket_keepalive  = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.enabled                  = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.enforce_fips_mode        = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.expiration_time          = 600 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.hashclient_retry_attempts = 2 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.memcache_dead_retry      = 300 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.memcache_sasl_enabled    = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.password                 = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.proxies                  = [] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.redis_db                 = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.redis_sentinel_service_name = mymaster {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.redis_server             = localhost:6379 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.retry_attempts           = 2 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.retry_delay              = 0.0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.socket_keepalive_count   = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.socket_keepalive_idle    = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.socket_keepalive_interval = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.socket_timeout           = 1.0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.tls_allowed_ciphers      = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.tls_cafile               = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.tls_certfile             = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.tls_enabled              = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.tls_keyfile              = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cache.username                 = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] coordination.backend_url       = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.asyncio_connection    = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.asyncio_slave_connection = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.backend               = sqlalchemy {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.connection            = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.connection_debug      = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.connection_parameters =  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.connection_recycle_time = 3600 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.connection_trace      = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.db_inc_retry_interval = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.db_max_retries        = 20 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.db_max_retry_interval = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.db_retry_interval     = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.max_overflow          = 50 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.max_pool_size         = 5 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.max_retries           = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.mysql_wsrep_sync_wait = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.pool_timeout          = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.retry_interval        = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.slave_connection      = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.sqlite_synchronous    = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.synchronous_reader    = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] database.use_db_reconnect      = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler.connection_string     = messaging:// {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler.enabled               = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler.es_doc_type           = notification {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler.es_scroll_size        = 10000 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler.es_scroll_time        = 2m {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler.filter_error_trace    = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler.hmac_keys             = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler.sentinel_service_name = mymaster {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler.socket_timeout        = 0.1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler.trace_requests        = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler.trace_sqlalchemy      = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler_jaeger.process_tags   = {} {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler_jaeger.service_name_prefix = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] profiler_otlp.service_name_prefix = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_policy.enforce_new_defaults = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: WARNING oslo_config.cfg [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_policy.enforce_scope      = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_policy.policy_default_rule = default {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] privsep_osbrick.group          = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] privsep_osbrick.helper_command = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] privsep_osbrick.user           = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cinder_sys_admin.group         = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cinder_sys_admin.helper_command = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] cinder_sys_admin.user          = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] service_user.auth_section      = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] service_user.auth_type         = password {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] service_user.cafile            = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] service_user.certfile          = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] service_user.collect_timing    = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] service_user.insecure          = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] service_user.keyfile           = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] service_user.send_service_user_token = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] service_user.split_loggers     = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] service_user.timeout           = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance.auth_section            = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance.auth_type               = password {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance.certfile                = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance.collect_timing          = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance.insecure                = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance.keyfile                 = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance.region_name             = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance.split_loggers           = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] glance.timeout                 = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.backend_availability_zone = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.chap_password = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.chap_username =  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.067s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.disk_geometry = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.driver_client_cert = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.driver_client_cert_key = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.driver_data_namespace = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.driver_use_ssl = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.enable_unsupported_driver = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.extra_capabilities = {} {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.filter_function = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.goodness_function = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.iscsi_target_flags =  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.iscsi_write_cache = on {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.iser_helper   = tgtadm {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.iser_ip_address = 192.168.122.192 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.iser_port     = 3260 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.lvm_share_target = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.lvm_type      = auto {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.num_shell_tries = 3 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.nvmet_port_id = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.replication_device = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.report_discard_supported = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.reserved_percentage = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.scst_target_driver = iscsi {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.scst_target_iqn_name = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.storage_protocol = iSCSI {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.target_helper = tgtadm {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.target_ip_address = 192.168.122.192 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.target_port   = 3260 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.target_protocol = iscsi {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.trace_flags   = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.unique_fqdn_network = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.use_chap_auth = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.volume_backend_name = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.volume_clear  = zero {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.volume_clear_ionice = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.volume_clear_size = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:10 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_reports.file_event_handler = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_reports.log_dir           = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.backend_availability_zone = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.backend_host       = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.chap_password      = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.chap_username      = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.disk_geometry      = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.driver_client_cert = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.driver_data_namespace = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.extra_capabilities = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.filter_function    = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.goodness_function  = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.iser_helper        = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.iser_ip_address    = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.iser_port          = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.iser_target_prefix = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.lvm_share_target   = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.lvm_type           = auto {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.num_shell_tries    = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.replication_device = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.report_discard_supported = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.reserved_percentage = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.scst_target_driver = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.storage_protocol   = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.target_helper      = lioadm {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.target_ip_address  = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.target_port        = 3260 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.trace_flags        = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.use_chap_auth      = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.volume_clear       = zero {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.volume_clear_size  = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] lvmdriver-1.volumes_dir        = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_notifications.driver = [] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_notifications.retry = -1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] key_manager.fixed_key          = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.barbican_api_version  = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.barbican_endpoint     = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.barbican_endpoint_type = public {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.barbican_region_name  = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.cafile                = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.certfile              = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.collect_timing        = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.insecure              = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.keyfile               = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.number_of_retries     = 60 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.retry_delay           = 1 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.send_service_user_token = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.split_loggers         = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.timeout               = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.verify_ssl            = True {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican.verify_ssl_path       = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican_service_user.auth_section = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican_service_user.auth_type = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican_service_user.cafile   = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican_service_user.certfile = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican_service_user.collect_timing = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican_service_user.insecure = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican_service_user.keyfile  = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican_service_user.split_loggers = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] barbican_service_user.timeout  = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] vault.approle_role_id          = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] vault.approle_secret_id        = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] vault.kv_mountpoint            = secret {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] vault.kv_path                  = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] vault.kv_version               = 2 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] vault.namespace                = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] vault.root_token_id            = **** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] vault.ssl_ca_crt_file          = None {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] vault.timeout                  = 60.0 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] vault.use_ssl                  = False {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:10:11 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] ******************************************************************************** {{(pid=71767) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 28 02:10:11 devstack sudo[71877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 28 02:10:11 devstack sudo[71877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:11 devstack sudo[71877]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:11 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.534s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:11 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:11 devstack sudo[71945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 02:10:11 devstack sudo[71945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:12 devstack sudo[71945]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:12 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.561s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:12 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:10:12 devstack cinder-volume[71872]: INFO cinder.brick.local_dev.lvm [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 28 02:10:12 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:12 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:12 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:12 devstack sudo[72188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 02:10:12 devstack sudo[72188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:12 devstack sudo[72188]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:12 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.535s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:12 devstack cinder-volume[71872]: DEBUG cinder.brick.local_dev.lvm [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=71872) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 28 02:10:12 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:12 devstack sudo[72367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 02:10:12 devstack sudo[72367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:13 devstack sudo[72367]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:13 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.091s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:13 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:13 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:13 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:13 devstack sudo[72523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 02:10:13 devstack sudo[72523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:14 devstack sudo[72523]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:14 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.942s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:14 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:14 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:14 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:14 devstack sudo[72583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 28 02:10:14 devstack sudo[72583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:15 devstack sudo[72583]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:15 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.620s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:15 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:15 devstack sudo[72594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 02:10:15 devstack sudo[72594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:16 devstack sudo[72594]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:16 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:16 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:16 devstack sudo[72629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 02:10:16 devstack sudo[72629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:16 devstack sudo[72629]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:16 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:16 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:16 devstack sudo[72632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 02:10:16 devstack sudo[72632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:16 devstack sudo[72632]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:16 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:17 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:17 devstack sudo[72638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 02:10:17 devstack sudo[72638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:17 devstack sudo[72638]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:17 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:17 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:17 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:17 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:17 devstack sudo[72642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 02:10:17 devstack sudo[72642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:18 devstack sudo[72642]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:18 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:18 devstack cinder-volume[71872]: INFO cinder.volume.drivers.lvm [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 28 02:10:18 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:18 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:18 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:18 devstack sudo[72745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 02:10:18 devstack sudo[72745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:18 devstack sudo[72745]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:18 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.450s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:18 devstack cinder-volume[71872]: DEBUG cinder.volume.drivers.lvm [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Updating volume stats {{(pid=71872) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 28 02:10:18 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:18 devstack sudo[72768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 02:10:18 devstack sudo[72768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:19 devstack sudo[72768]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:19 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:19 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:19 devstack sudo[72823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 02:10:19 devstack sudo[72823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:19 devstack sudo[72823]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:19 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:19 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:19 devstack sudo[72912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 02:10:19 devstack sudo[72912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:20 devstack sudo[72912]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:20 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.475s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:20 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:20 devstack sudo[72915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 02:10:20 devstack sudo[72915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:20 devstack sudo[72915]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:20 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:20 devstack cinder-volume[71872]: INFO cinder.volume.driver [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Driver hasn't implemented _init_vendor_properties()
Apr 28 02:10:20 devstack cinder-volume[71872]: DEBUG cinder.volume.driver [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=71872) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 28 02:10:20 devstack cinder-volume[71872]: DEBUG oslo_db.sqlalchemy.engines [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 02:10:20 devstack cinder-volume[71872]: DEBUG dbcounter [-] [71872] Writer thread running {{(pid=71872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 28 02:10:20 devstack cinder-volume[71872]: DEBUG cinder.db.sqlalchemy.api [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Building query based on filter {{(pid=71872) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 28 02:10:20 devstack cinder-volume[71872]: DEBUG cinder.image.image_utils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=71872) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 28 02:10:20 devstack cinder-volume[71872]: INFO cinder.keymgr.migration [None req-a195c791-e588-4984-8613-507d05cc2268 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 28 02:10:20 devstack cinder-volume[71872]: DEBUG cinder.volume.drivers.lvm [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Updating volume stats {{(pid=71872) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 28 02:10:20 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:20 devstack sudo[72923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 02:10:20 devstack sudo[72923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:20 devstack cinder-volume[71767]: DEBUG dbcounter [-] [71767] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=71767) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:10:21 devstack sudo[72923]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:21 devstack sudo[72933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 02:10:21 devstack sudo[72933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:21 devstack sudo[72933]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:21 devstack sudo[72937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 02:10:21 devstack sudo[72937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:22 devstack sudo[72937]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:22 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.562s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:22 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:22 devstack sudo[72941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 02:10:22 devstack sudo[72941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:22 devstack sudo[72941]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:22 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.552s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:22 devstack cinder-volume[71872]: DEBUG cinder.manager [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Notifying Schedulers of capabilities ... {{(pid=71872) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:10:22 devstack cinder-volume[71872]: INFO cinder.volume.manager [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Driver initialization completed successfully.
Apr 28 02:10:22 devstack cinder-volume[71872]: INFO cinder.manager [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Initiating service 2 cleanup
Apr 28 02:10:22 devstack cinder-volume[71872]: INFO cinder.manager [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Service 2 cleanup completed.
Apr 28 02:10:22 devstack cinder-volume[71872]: DEBUG cinder.service [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Creating RPC server for service cinder-volume {{(pid=71872) start /opt/stack/cinder/cinder/service.py:231}}
Apr 28 02:10:22 devstack cinder-volume[71872]: DEBUG cinder.service [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=71872) start /opt/stack/cinder/cinder/service.py:237}}
Apr 28 02:10:22 devstack cinder-volume[71872]: INFO cinder.volume.manager [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 28 02:10:22 devstack cinder-volume[71872]: DEBUG cinder.volume.drivers.lvm [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Updating volume stats {{(pid=71872) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 28 02:10:22 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:22 devstack sudo[72947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 02:10:22 devstack sudo[72947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:23 devstack sudo[72947]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:23 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.567s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:23 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:23 devstack sudo[72951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 02:10:23 devstack sudo[72951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:23 devstack sudo[72951]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:23 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:23 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:23 devstack sudo[72954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 02:10:23 devstack sudo[72954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:24 devstack sudo[72954]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:24 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:24 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:10:24 devstack sudo[73068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 02:10:24 devstack sudo[73068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:10:24 devstack sudo[73068]: pam_unix(sudo:session): session closed for user root
Apr 28 02:10:24 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:10:24 devstack cinder-volume[71872]: INFO cinder.volume.manager [None req-8e538774-0cf1-4a24-9b1a-bd630a2639e5 None None] Driver post RPC initialization completed successfully.
Apr 28 02:10:34 devstack cinder-volume[71872]: DEBUG dbcounter [-] [71872] Writing DB stats cinder:SELECT=3 {{(pid=71872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:10:34 devstack cinder-volume[71872]: DEBUG dbcounter [-] [71872] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=71872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:11:20 devstack cinder-volume[71872]: DEBUG oslo_service.periodic_task [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71872) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:11:20 devstack cinder-volume[71872]: DEBUG cinder.volume.drivers.lvm [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Updating volume stats {{(pid=71872) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 28 02:11:20 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:11:20 devstack sudo[75271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 02:11:20 devstack sudo[75271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:11:21 devstack sudo[75271]: pam_unix(sudo:session): session closed for user root
Apr 28 02:11:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.525s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:11:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:11:21 devstack sudo[75280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 02:11:21 devstack sudo[75280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:11:21 devstack sudo[75280]: pam_unix(sudo:session): session closed for user root
Apr 28 02:11:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:11:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:11:21 devstack sudo[75457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 02:11:21 devstack sudo[75457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:11:22 devstack sudo[75457]: pam_unix(sudo:session): session closed for user root
Apr 28 02:11:22 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.452s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:11:22 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:11:22 devstack sudo[75732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 02:11:22 devstack sudo[75732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:11:22 devstack sudo[75732]: pam_unix(sudo:session): session closed for user root
Apr 28 02:11:22 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:11:22 devstack cinder-volume[71872]: DEBUG cinder.manager [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Notifying Schedulers of capabilities ... {{(pid=71872) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:12:20 devstack cinder-volume[71872]: DEBUG oslo_service.periodic_task [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71872) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:12:20 devstack cinder-volume[71872]: DEBUG cinder.volume.drivers.lvm [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Updating volume stats {{(pid=71872) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 28 02:12:20 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:12:20 devstack sudo[78077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 02:12:20 devstack sudo[78077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:12:21 devstack sudo[78077]: pam_unix(sudo:session): session closed for user root
Apr 28 02:12:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:12:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:12:21 devstack sudo[78095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 02:12:21 devstack sudo[78095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:12:21 devstack sudo[78095]: pam_unix(sudo:session): session closed for user root
Apr 28 02:12:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:12:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:12:21 devstack sudo[78101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 02:12:21 devstack sudo[78101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:12:22 devstack sudo[78101]: pam_unix(sudo:session): session closed for user root
Apr 28 02:12:22 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:12:22 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:12:22 devstack sudo[78111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 02:12:22 devstack sudo[78111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:12:22 devstack sudo[78111]: pam_unix(sudo:session): session closed for user root
Apr 28 02:12:22 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:12:22 devstack cinder-volume[71872]: DEBUG cinder.manager [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Notifying Schedulers of capabilities ... {{(pid=71872) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:12:34 devstack cinder-volume[71872]: DEBUG dbcounter [-] [71872] Writing DB stats cinder:SELECT=1 {{(pid=71872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:12:34 devstack cinder-volume[71872]: DEBUG dbcounter [-] [71872] Writing DB stats cinder:UPDATE=1 {{(pid=71872) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:13:20 devstack cinder-volume[71872]: DEBUG oslo_service.periodic_task [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71872) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:13:20 devstack cinder-volume[71872]: DEBUG cinder.volume.drivers.lvm [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Updating volume stats {{(pid=71872) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 28 02:13:20 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:13:20 devstack sudo[80159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 28 02:13:20 devstack sudo[80159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:13:21 devstack sudo[80159]: pam_unix(sudo:session): session closed for user root
Apr 28 02:13:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:13:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:13:21 devstack sudo[80179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 02:13:21 devstack sudo[80179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:13:21 devstack sudo[80179]: pam_unix(sudo:session): session closed for user root
Apr 28 02:13:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:13:21 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:13:21 devstack sudo[80184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 28 02:13:21 devstack sudo[80184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:13:22 devstack sudo[80184]: pam_unix(sudo:session): session closed for user root
Apr 28 02:13:22 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.492s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:13:22 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:13:22 devstack sudo[80210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 28 02:13:22 devstack sudo[80210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:13:22 devstack sudo[80210]: pam_unix(sudo:session): session closed for user root
Apr 28 02:13:22 devstack cinder-volume[71872]: DEBUG oslo_concurrency.processutils [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=71872) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:13:22 devstack cinder-volume[71872]: DEBUG cinder.manager [None req-8cad4fbf-2321-40db-b0f1-0ad87864cf2d None None] Notifying Schedulers of capabilities ... {{(pid=71872) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:13:53 devstack cinder-volume[71767]: INFO oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Caught SIGTERM, stopping children
Apr 28 02:13:53 devstack cinder-volume[71767]: DEBUG oslo_concurrency.lockutils [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Acquiring lock "singleton_lock" {{(pid=71767) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 02:13:53 devstack cinder-volume[71767]: DEBUG oslo_concurrency.lockutils [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Acquired lock "singleton_lock" {{(pid=71767) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 02:13:53 devstack cinder-volume[71767]: DEBUG oslo_concurrency.lockutils [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Releasing lock "singleton_lock" {{(pid=71767) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 02:13:53 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Stop services. {{(pid=71767) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 28 02:13:53 devstack cinder-volume[71767]: DEBUG oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Killing children. {{(pid=71767) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 28 02:13:53 devstack cinder-volume[71767]: INFO oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Waiting on 1 children to exit
Apr 28 02:13:57 devstack cinder-volume[71872]: DEBUG oslo_concurrency.lockutils [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Acquiring lock "singleton_lock" {{(pid=71872) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 02:13:57 devstack cinder-volume[71872]: DEBUG oslo_concurrency.lockutils [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Acquired lock "singleton_lock" {{(pid=71872) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 02:13:57 devstack cinder-volume[71872]: DEBUG oslo_concurrency.lockutils [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Releasing lock "singleton_lock" {{(pid=71872) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 02:13:57 devstack cinder-volume[71872]: WARNING amqp [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 28 02:13:57 devstack cinder-volume[71872]: WARNING amqp [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 28 02:13:57 devstack cinder-volume[71767]: INFO oslo_service.backend._eventlet.service [None req-8d592046-ffcf-46b3-96af-705aa1ad1267 None None] Child 71872 exited with status 0
Apr 28 02:13:58 devstack cinder-volume[80892]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 28 02:13:58 devstack cinder-volume[80892]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 28 02:13:58 devstack cinder-volume[80892]: we strongly recommend against using it for new projects.
Apr 28 02:13:58 devstack cinder-volume[80892]: If you are already using Eventlet, we recommend migrating to a different
Apr 28 02:13:58 devstack cinder-volume[80892]: framework.  For more detail see
Apr 28 02:13:58 devstack cinder-volume[80892]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 28 02:13:58 devstack cinder-volume[80892]:   import eventlet  # noqa
Apr 28 02:14:00 devstack cinder-volume[80892]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 02:14:00 devstack cinder-volume[80892]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 02:14:00 devstack cinder-volume[80892]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 02:14:00 devstack cinder-volume[80892]: INFO dbcounter [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Registered counter for database cinder
Apr 28 02:14:00 devstack cinder-volume[80892]: DEBUG oslo_db.sqlalchemy.engines [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80892) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG dbcounter [-] [80892] Writer thread running {{(pid=80892) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 28 02:14:01 devstack cinder-volume[80892]: INFO cinder.rpc [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 28 02:14:01 devstack cinder-volume[80892]: INFO cinder.rpc [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_db.sqlalchemy.engines [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80892) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 02:14:01 devstack cinder-volume[80892]: INFO cinder.volume.manager [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Determined volume DB was empty at startup.
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG cinder.volume.manager [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80892) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 28 02:14:01 devstack cinder-volume[80892]: INFO cinder.volume.manager [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 28 02:14:01 devstack cinder-volume[80892]: WARNING stevedore.named [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 28 02:14:01 devstack cinder-volume[80892]: WARNING castellan.key_manager [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 02:14:01 devstack cinder-volume[80892]: WARNING cinder.keymgr.conf_key_mgr [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 02:14:01 devstack cinder-volume[80892]: INFO cinder.volume.manager [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_db.sqlalchemy.engines [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80892) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 02:14:01 devstack cinder-volume[80892]: INFO oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Starting 1 workers
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Started child 81010 {{(pid=80892) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Full set of CONF: {{(pid=80892) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] ******************************************************************************** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Configuration options gathered from: {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] ================================================================================ {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] allow_availability_zone_fallback = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[81010]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] allow_compression_on_image_upload = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] allowed_direct_url_schemes     = [] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] api_rate_limit                 = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] auth_strategy                  = keystone {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_availability_zone      = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_host                   = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_name                   = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_stats_polling_interval = 60 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backup_api_class               = cinder.backup.api.API {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backup_name_template           = backup-%s {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backup_use_same_host           = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backup_use_temp_snapshot       = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] chap_password                  = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] chap_username                  =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cinder_internal_tenant_project_id = 5cd267741f9f4f0b9b226b32048ed709 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cinder_internal_tenant_user_id = 748e81f417654c5496df0fc86c3e19db {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cluster                        = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] compression_format             = gzip {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] compute_api_class              = cinder.compute.nova.API {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] config_dir                     = [] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] config_source                  = [] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] control_exchange               = openstack {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] debug                          = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] default_availability_zone      = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] default_group_type             = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] default_volume_type            = QuobyteHD {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] disk_geometry                  = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] driver_client_cert             = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] driver_client_cert_key         = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] driver_data_namespace          = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] driver_ssl_cert_path           = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] driver_ssl_cert_verify         = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] driver_use_ssl                 = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] enable_new_services            = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] enable_unsupported_driver      = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] enabled_backends               = ['QuobyteHD'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] enforce_multipath_for_image_xfer = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] filter_function                = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance_api_insecure            = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance_api_servers             = ['http://192.168.122.192/image'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance_api_ssl_compression     = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance_ca_certificates_file    = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance_catalog_info            = image:glance:publicURL {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance_certfile                = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance_keyfile                 = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance_num_retries             = 3 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance_request_timeout         = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] goodness_function              = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] graceful_shutdown_timeout      = 5 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] group_api_class                = cinder.group.api.API {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] host                           = devstack {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] image_compress_on_upload       = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] image_conversion_address_space_limit = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] image_conversion_cpu_limit     = 60 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] image_conversion_disable       = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] image_upload_use_cinder_backend = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] image_upload_use_internal_tenant = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] image_volume_cache_enabled     = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] image_volume_cache_max_count   = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] image_volume_cache_max_size_gb = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] init_host_max_objects_retrieval = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] instance_format                = [instance: %(uuid)s]  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] iscsi_target_flags             =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] iscsi_write_cache              = on {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] iser_helper                    = tgtadm {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] iser_ip_address                = 192.168.122.192 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] iser_port                      = 3260 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] log_color                      = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] log_config_append              = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] log_dir                        = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] log_file                       = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] log_options                    = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] log_rotate_interval            = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] log_rotate_interval_type       = days {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] log_rotation_type              = none {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] max_age                        = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] max_logfile_count              = 30 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] max_logfile_size_mb            = 200 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[81010]: INFO cinder.volume.manager [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] max_over_subscription_ratio    = 20.0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] message_reap_interval          = 86400 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] message_ttl                    = 2592000 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] migration_create_volume_timeout_secs = 300 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] monkey_patch                   = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] monkey_patch_modules           = [] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] my_ip                          = 192.168.122.192 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] no_snapshot_gb_quota           = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] num_iser_scan_tries            = 3 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] num_shell_tries                = 3 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] num_volume_device_scan_tries   = 3 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] nvmeof_conn_info_version       = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] nvmet_ns_id                    = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] nvmet_port_id                  = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] osapi_max_limit                = 1000 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] osapi_volume_ext_list          = [] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] osapi_volume_listen_port       = 8776 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] osapi_volume_use_ssl           = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] osapi_volume_workers           = 2 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[81010]: DEBUG cinder.volume.drivers.remotefs [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81010) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] per_volume_size_limit          = -1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] periodic_fuzzy_delay           = 60 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] periodic_interval              = 60 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] public_endpoint                = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] publish_errors                 = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] quota_backup_gigabytes         = 1000 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] quota_backups                  = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] quota_gigabytes                = 1000 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] quota_groups                   = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] quota_snapshots                = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] quota_volumes                  = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] rate_limit_burst               = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] rate_limit_except_level        = CRITICAL {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] rate_limit_interval            = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] reinit_driver_count            = 3 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] replication_device             = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] report_discard_supported       = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] report_interval                = 120 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] reservation_clean_interval     = 86400 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] reservation_expire             = 86400 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] reserved_image_namespaces      = [] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] reserved_percentage            = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] rpc_response_timeout           = 120 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] run_external_periodic_tasks    = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] scst_target_driver             = iscsi {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] scst_target_iqn_name           = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] service_down_time              = 720 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] shell_completion               = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] snapshot_name_template         = snapshot-%s {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] split_loggers                  = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] state_path                     = /opt/stack/data/cinder {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] storage_availability_zone      = nova {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] storage_protocol               = iSCSI {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] syslog_log_facility            = LOG_USER {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] target_helper                  = lioadm {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] target_ip_address              = 192.168.122.192 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] target_port                    = 3260 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] target_protocol                = iscsi {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] target_secondary_ip_addresses  = [] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] trace_flags                    = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] transport_url                  = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] until_refresh                  = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] use_chap_auth                  = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] use_default_quota_class        = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] use_journal                    = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] use_json                       = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] use_multipath_for_image_xfer   = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] use_stderr                     = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] use_syslog                     = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] verify_glance_signatures       = enabled {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] volume_api_class               = cinder.volume.api.API {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] volume_backend_name            = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] volume_clear                   = zero {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] volume_clear_ionice            = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] volume_clear_size              = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] volume_copy_bps_limit          = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] volume_dd_blocksize            = 1M {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] volume_name_template           = volume-%s {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] volume_service_inithost_offload = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] volume_usage_audit_period      = month {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] zoning_mode                    = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_concurrency.disable_process_locking = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.admin_password = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.admin_token = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.admin_user  = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.auth_port   = 35357 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.auth_protocol = https {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.auth_section = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.auth_type   = password {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.auth_uri    = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.auth_version = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.cache       = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.certfile    = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.delay_auth_decision = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.http_connect_timeout = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.identity_uri = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.include_service_catalog = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.insecure    = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.interface   = public {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.keyfile     = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_password =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcache_username =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.region_name = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.service_token_roles_required = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.service_type = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.token_cache_time = 300 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.192/identity {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.backend                  = dogpile.cache.null {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.backend_argument         = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.backend_expiration_time  = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.config_prefix            = cache.oslo {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.debug_cache_backend      = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.enable_retry_client      = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.enable_socket_keepalive  = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.enabled                  = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.enforce_fips_mode        = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.expiration_time          = 600 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.hashclient_retry_attempts = 2 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.memcache_dead_retry      = 300 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.memcache_pool_maxsize    = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.memcache_sasl_enabled    = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.password                 = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.proxies                  = [] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.redis_db                 = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.redis_sentinel_service_name = mymaster {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.redis_server             = localhost:6379 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.retry_attempts           = 2 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.retry_delay              = 0.0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.socket_keepalive_count   = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.socket_keepalive_idle    = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.socket_keepalive_interval = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[81010]: DEBUG cinder.volume.drivers.quobyte [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81010) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 28 02:14:01 devstack cinder-volume[81010]: WARNING cinder.volume.drivers.quobyte [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.socket_timeout           = 1.0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[81010]: WARNING cinder.volume.drivers.quobyte [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.tls_allowed_ciphers      = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.tls_cafile               = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.tls_certfile             = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.tls_enabled              = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.tls_keyfile              = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[81010]: DEBUG oslo_concurrency.processutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Running cmd (subprocess): mount.quobyte {{(pid=81010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cache.username                 = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] coordination.backend_url       = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.asyncio_connection    = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.asyncio_slave_connection = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.backend               = sqlalchemy {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.connection            = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.connection_debug      = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.connection_parameters =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.connection_recycle_time = 3600 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.connection_trace      = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.db_inc_retry_interval = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.db_max_retries        = 20 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.db_max_retry_interval = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.db_retry_interval     = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.max_overflow          = 50 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.max_pool_size         = 5 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.max_retries           = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.mysql_wsrep_sync_wait = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.pool_timeout          = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.retry_interval        = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.slave_connection      = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.sqlite_synchronous    = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.synchronous_reader    = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] database.use_db_reconnect      = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler.connection_string     = messaging:// {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler.enabled               = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler.es_doc_type           = notification {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler.es_scroll_size        = 10000 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler.es_scroll_time        = 2m {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler.filter_error_trace    = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler.hmac_keys             = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler.sentinel_service_name = mymaster {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler.socket_timeout        = 0.1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler.trace_requests        = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler.trace_sqlalchemy      = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler_jaeger.process_tags   = {} {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler_jaeger.service_name_prefix = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] profiler_otlp.service_name_prefix = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_policy.enforce_new_defaults = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: WARNING oslo_config.cfg [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_policy.enforce_scope      = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_policy.policy_default_rule = default {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_policy.policy_file        = policy.yaml {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] privsep_osbrick.group          = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] privsep_osbrick.helper_command = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] privsep_osbrick.user           = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cinder_sys_admin.group         = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cinder_sys_admin.helper_command = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] cinder_sys_admin.user          = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] service_user.auth_section      = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] service_user.auth_type         = password {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] service_user.cafile            = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] service_user.certfile          = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] service_user.collect_timing    = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] service_user.insecure          = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] service_user.keyfile           = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] service_user.send_service_user_token = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] service_user.split_loggers     = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] service_user.timeout           = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance.auth_section            = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance.auth_type               = password {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance.certfile                = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance.collect_timing          = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance.insecure                = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance.keyfile                 = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance.region_name             = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance.split_loggers           = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] glance.timeout                 = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.backend_availability_zone = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.chap_password = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.chap_username =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.disk_geometry = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.driver_client_cert = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.driver_client_cert_key = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.driver_data_namespace = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.driver_use_ssl = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.enable_unsupported_driver = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.extra_capabilities = {} {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.filter_function = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.goodness_function = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.iscsi_target_flags =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.iscsi_write_cache = on {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.iser_helper   = tgtadm {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.iser_ip_address = 192.168.122.192 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.iser_port     = 3260 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.nas_host      =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.nas_login     = admin {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.nas_mount_options = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.nas_password  = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.nas_private_key =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.nas_share_path =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.num_shell_tries = 3 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.nvmet_port_id = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.quobyte_client_cfg = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.quobyte_volume_url = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.replication_device = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.report_discard_supported = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.reserved_percentage = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.scst_target_driver = iscsi {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.scst_target_iqn_name = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.storage_protocol = iSCSI {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.target_helper = tgtadm {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.target_ip_address = 192.168.122.192 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.target_port   = 3260 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.target_protocol = iscsi {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.trace_flags   = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.unique_fqdn_network = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.use_chap_auth = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.volume_backend_name = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.volume_clear  = zero {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.volume_clear_ionice = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.volume_clear_size = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_reports.file_event_handler = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_reports.log_dir           = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.backend_availability_zone = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.backend_host         = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.chap_password        = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.chap_username        = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.chiscsi_conf         = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.disk_geometry        = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.driver_client_cert   = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.driver_client_cert_key = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.driver_data_namespace = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.driver_use_ssl       = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.extra_capabilities   = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.filter_function      = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.goodness_function    = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.iser_helper          = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.iser_ip_address      = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.iser_port            = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.iser_target_prefix   = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.nas_host             = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.nas_login            = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.nas_mount_options    = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.nas_password         = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.nas_private_key      = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.nas_share_path       = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.nas_ssh_port         = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.num_shell_tries      = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack quobyte-client[81011]: Reading configuration file: /etc/quobyte/client.cfg
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.nvmet_port_id        = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack quobyte-client[81011]: Invalid parameters found, error: missing mount point.
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.replication_device   = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.report_discard_supported = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.reserved_percentage  = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.scst_target_driver   = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack quobyte-client[81011]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.storage_protocol     = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.target_helper        = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.target_ip_address    = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.target_port          = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.target_prefix        = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack quobyte-client[81011]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.target_protocol      = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.trace_flags          = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.use_chap_auth        = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.volume_clear         = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.volume_clear_size    = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] QuobyteHD.volumes_dir          = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.ssl      = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_notifications.driver = [] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_notifications.retry = -1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] oslo_messaging_notifications.transport_url = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] key_manager.fixed_key          = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[81010]: DEBUG oslo_concurrency.processutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=81010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:14:01 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:14:01 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:14:01 devstack cinder-volume[81010]: DEBUG cinder.volume.drivers.quobyte [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81010) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:14:01 devstack cinder-volume[81010]: INFO cinder.volume.drivers.quobyte [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 ...
Apr 28 02:14:01 devstack cinder-volume[81010]: DEBUG oslo_concurrency.processutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 -c /etc/quobyte/client-cinder.cfg {{(pid=81010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.barbican_api_version  = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.barbican_endpoint     = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.barbican_endpoint_type = public {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.barbican_region_name  = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.cafile                = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.certfile              = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.collect_timing        = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.insecure              = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.keyfile               = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.number_of_retries     = 60 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.retry_delay           = 1 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.send_service_user_token = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.split_loggers         = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.timeout               = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.verify_ssl            = True {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican.verify_ssl_path       = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican_service_user.auth_section = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican_service_user.auth_type = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican_service_user.cafile   = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican_service_user.certfile = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican_service_user.collect_timing = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican_service_user.insecure = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican_service_user.keyfile  = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican_service_user.split_loggers = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] barbican_service_user.timeout  = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] vault.approle_role_id          = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] vault.approle_secret_id        = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] vault.kv_mountpoint            = secret {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] vault.kv_path                  = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] vault.kv_version               = 2 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] vault.namespace                = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] vault.root_token_id            = **** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] vault.ssl_ca_crt_file          = None {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] vault.timeout                  = 60.0 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] vault.use_ssl                  = False {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:01 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] ******************************************************************************** {{(pid=80892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 28 02:14:01 devstack sudo[81012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 -c /etc/quobyte/client-cinder.cfg
Apr 28 02:14:01 devstack sudo[81012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:14:02 devstack sudo[81012]: pam_unix(sudo:session): session closed for user root
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG oslo_concurrency.processutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.576s {{(pid=81010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:14:02 devstack cinder-volume[81010]: INFO cinder.volume.drivers.quobyte [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 succeeded
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG cinder.volume.drivers.quobyte [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81010) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.585s {{(pid=81010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG oslo_concurrency.processutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:14:02 devstack sudo[81081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:14:02 devstack sudo[81081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:14:02 devstack sudo[81081]: pam_unix(sudo:session): session closed for user root
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG oslo_concurrency.processutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.409s {{(pid=81010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:14:02 devstack cinder-volume[81010]: INFO cinder.volume.driver [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Driver hasn't implemented _init_vendor_properties()
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG cinder.volume.driver [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732765197754, 'free_capacity_gb': 1775.732765197754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81010) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG oslo_db.sqlalchemy.engines [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81010) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG dbcounter [-] [81010] Writer thread running {{(pid=81010) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG cinder.db.sqlalchemy.api [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Building query based on filter {{(pid=81010) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG cinder.image.image_utils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81010) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 28 02:14:02 devstack cinder-volume[81010]: INFO cinder.keymgr.migration [None req-d81adee2-d0aa-4a7f-a632-4359fad34c72 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG cinder.volume.drivers.quobyte [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81010) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG cinder.volume.drivers.quobyte [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81010) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG oslo_concurrency.processutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:14:02 devstack sudo[81084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:14:02 devstack sudo[81084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:14:02 devstack sudo[81084]: pam_unix(sudo:session): session closed for user root
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG oslo_concurrency.processutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.430s {{(pid=81010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG cinder.manager [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Notifying Schedulers of capabilities ... {{(pid=81010) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:14:02 devstack cinder-volume[81010]: INFO cinder.volume.manager [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Driver initialization completed successfully.
Apr 28 02:14:02 devstack cinder-volume[81010]: INFO cinder.manager [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Initiating service 3 cleanup
Apr 28 02:14:02 devstack cinder-volume[81010]: INFO cinder.manager [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Service 3 cleanup completed.
Apr 28 02:14:02 devstack cinder-volume[81010]: DEBUG cinder.service [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Creating RPC server for service cinder-volume {{(pid=81010) start /opt/stack/cinder/cinder/service.py:231}}
Apr 28 02:14:03 devstack cinder-volume[81010]: DEBUG cinder.service [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81010) start /opt/stack/cinder/cinder/service.py:237}}
Apr 28 02:14:03 devstack cinder-volume[81010]: INFO cinder.volume.manager [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 28 02:14:03 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:14:03 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:14:03 devstack cinder-volume[81010]: DEBUG cinder.volume.drivers.quobyte [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81010) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:14:03 devstack cinder-volume[81010]: DEBUG cinder.volume.drivers.quobyte [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81010) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:14:03 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:14:03 devstack cinder-volume[81010]: DEBUG oslo_concurrency.processutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:14:03 devstack sudo[81094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:14:03 devstack sudo[81094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:14:03 devstack sudo[81094]: pam_unix(sudo:session): session closed for user root
Apr 28 02:14:03 devstack cinder-volume[81010]: DEBUG oslo_concurrency.processutils [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.693s {{(pid=81010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:14:03 devstack cinder-volume[81010]: INFO cinder.volume.manager [None req-7d423e25-40ad-410f-8bef-6521ad05573b None None] Driver post RPC initialization completed successfully.
Apr 28 02:14:07 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-7f899e1b-5574-4699-9b5f-b26cd31ec1a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:14:07 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-7f899e1b-5574-4699-9b5f-b26cd31ec1a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:14:07 devstack cinder-volume[81010]: DEBUG cinder.volume.drivers.quobyte [None req-7f899e1b-5574-4699-9b5f-b26cd31ec1a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81010) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:14:07 devstack cinder-volume[81010]: DEBUG cinder.volume.drivers.quobyte [None req-7f899e1b-5574-4699-9b5f-b26cd31ec1a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81010) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:14:07 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-7f899e1b-5574-4699-9b5f-b26cd31ec1a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81010) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:14:07 devstack cinder-volume[81010]: DEBUG oslo_concurrency.processutils [None req-7f899e1b-5574-4699-9b5f-b26cd31ec1a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:14:07 devstack sudo[81202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:14:07 devstack sudo[81202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:14:07 devstack sudo[81202]: pam_unix(sudo:session): session closed for user root
Apr 28 02:14:07 devstack cinder-volume[81010]: DEBUG oslo_concurrency.processutils [None req-7f899e1b-5574-4699-9b5f-b26cd31ec1a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.423s {{(pid=81010) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:14:07 devstack cinder-volume[81010]: DEBUG cinder.manager [None req-7f899e1b-5574-4699-9b5f-b26cd31ec1a1 None None] Notifying Schedulers of capabilities ... {{(pid=81010) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:14:09 devstack cinder-volume[80892]: INFO oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Caught SIGTERM, stopping children
Apr 28 02:14:09 devstack cinder-volume[80892]: DEBUG oslo_concurrency.lockutils [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Acquiring lock "singleton_lock" {{(pid=80892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 02:14:09 devstack cinder-volume[80892]: DEBUG oslo_concurrency.lockutils [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Acquired lock "singleton_lock" {{(pid=80892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 02:14:09 devstack cinder-volume[80892]: DEBUG oslo_concurrency.lockutils [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Releasing lock "singleton_lock" {{(pid=80892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 02:14:09 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Stop services. {{(pid=80892) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 28 02:14:09 devstack cinder-volume[80892]: DEBUG oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Killing children. {{(pid=80892) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 28 02:14:09 devstack cinder-volume[80892]: INFO oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Waiting on 1 children to exit
Apr 28 02:14:11 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Acquiring lock "singleton_lock" {{(pid=81010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 02:14:11 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Acquired lock "singleton_lock" {{(pid=81010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 02:14:11 devstack cinder-volume[81010]: DEBUG oslo_concurrency.lockutils [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Releasing lock "singleton_lock" {{(pid=81010) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 02:14:11 devstack cinder-volume[81010]: WARNING amqp [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 28 02:14:11 devstack cinder-volume[81010]: WARNING amqp [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 28 02:14:11 devstack cinder-volume[80892]: INFO oslo_service.backend._eventlet.service [None req-da23d872-18cc-4151-a68d-68ec3f0a0f85 None None] Child 81010 exited with status 0
Apr 28 02:14:11 devstack cinder-volume[81280]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 28 02:14:11 devstack cinder-volume[81280]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 28 02:14:11 devstack cinder-volume[81280]: we strongly recommend against using it for new projects.
Apr 28 02:14:11 devstack cinder-volume[81280]: If you are already using Eventlet, we recommend migrating to a different
Apr 28 02:14:11 devstack cinder-volume[81280]: framework.  For more detail see
Apr 28 02:14:11 devstack cinder-volume[81280]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 28 02:14:11 devstack cinder-volume[81280]:   import eventlet  # noqa
Apr 28 02:14:13 devstack cinder-volume[81280]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81280) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 28 02:14:13 devstack cinder-volume[81280]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81280) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 28 02:14:13 devstack cinder-volume[81280]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81280) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 28 02:14:14 devstack cinder-volume[81280]: INFO dbcounter [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] Registered counter for database cinder
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_db.sqlalchemy.engines [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81280) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG dbcounter [-] [81280] Writer thread running {{(pid=81280) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 28 02:14:14 devstack cinder-volume[81280]: INFO cinder.rpc [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 28 02:14:14 devstack cinder-volume[81280]: INFO cinder.rpc [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_db.sqlalchemy.engines [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81280) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 02:14:14 devstack cinder-volume[81280]: INFO cinder.volume.manager [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] Determined volume DB was empty at startup.
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG cinder.volume.manager [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81280) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 28 02:14:14 devstack cinder-volume[81280]: WARNING stevedore.named [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 28 02:14:14 devstack cinder-volume[81280]: WARNING castellan.key_manager [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 02:14:14 devstack cinder-volume[81280]: WARNING cinder.keymgr.conf_key_mgr [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 28 02:14:14 devstack cinder-volume[81280]: INFO cinder.volume.manager [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_db.sqlalchemy.engines [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81280) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 02:14:14 devstack cinder-volume[81280]: INFO oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] Starting 1 workers
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] Started child 81489 {{(pid=81280) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] Full set of CONF: {{(pid=81280) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] ******************************************************************************** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] Configuration options gathered from: {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] ================================================================================ {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 28 02:14:14 devstack cinder-volume[81489]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] allow_availability_zone_fallback = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] allow_compression_on_image_upload = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] allowed_direct_url_schemes     = [] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] api_rate_limit                 = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] auth_strategy                  = keystone {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_availability_zone      = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_host                   = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_name                   = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_stats_polling_interval = 60 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backup_api_class               = cinder.backup.api.API {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backup_name_template           = backup-%s {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backup_use_same_host           = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backup_use_temp_snapshot       = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] chap_password                  = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] chap_username                  =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cinder_internal_tenant_project_id = 5cd267741f9f4f0b9b226b32048ed709 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cinder_internal_tenant_user_id = 748e81f417654c5496df0fc86c3e19db {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cluster                        = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] compression_format             = gzip {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] config_dir                     = [] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] config_source                  = [] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] control_exchange               = openstack {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] debug                          = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] default_availability_zone      = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] default_group_type             = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] default_volume_type            = QuobyteHD {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] disk_geometry                  = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] driver_client_cert             = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] driver_client_cert_key         = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] driver_data_namespace          = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] driver_ssl_cert_path           = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] driver_ssl_cert_verify         = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] driver_use_ssl                 = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] enable_new_services            = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] enable_unsupported_driver      = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] enabled_backends               = ['QuobyteHD'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] enforce_multipath_for_image_xfer = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] filter_function                = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance_api_insecure            = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance_api_servers             = ['http://192.168.122.192/image'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance_api_ssl_compression     = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance_ca_certificates_file    = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81489) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance_certfile                = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance_keyfile                 = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance_num_retries             = 3 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance_request_timeout         = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] goodness_function              = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] graceful_shutdown_timeout      = 5 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] group_api_class                = cinder.group.api.API {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] host                           = devstack {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] image_compress_on_upload       = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] image_conversion_address_space_limit = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] image_conversion_cpu_limit     = 60 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] image_conversion_disable       = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] image_upload_use_cinder_backend = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] image_upload_use_internal_tenant = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] image_volume_cache_enabled     = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] image_volume_cache_max_count   = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] image_volume_cache_max_size_gb = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] init_host_max_objects_retrieval = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] iscsi_target_flags             =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] iscsi_write_cache              = on {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] iser_helper                    = tgtadm {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] iser_ip_address                = 192.168.122.192 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] iser_port                      = 3260 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] log_color                      = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] log_config_append              = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] log_dir                        = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] log_file                       = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] log_options                    = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] log_rotate_interval            = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] log_rotate_interval_type       = days {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] log_rotation_type              = none {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] max_age                        = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] max_logfile_count              = 30 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] max_logfile_size_mb            = 200 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] max_over_subscription_ratio    = 20.0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] message_reap_interval          = 86400 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] message_ttl                    = 2592000 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] migration_create_volume_timeout_secs = 300 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] monkey_patch                   = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] monkey_patch_modules           = [] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] my_ip                          = 192.168.122.192 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] no_snapshot_gb_quota           = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] num_iser_scan_tries            = 3 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] num_shell_tries                = 3 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] num_volume_device_scan_tries   = 3 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] nvmeof_conn_info_version       = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] nvmet_ns_id                    = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] nvmet_port_id                  = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] osapi_max_limit                = 1000 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] osapi_volume_ext_list          = [] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] osapi_volume_listen_port       = 8776 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] osapi_volume_use_ssl           = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] osapi_volume_workers           = 2 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] per_volume_size_limit          = -1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] periodic_fuzzy_delay           = 60 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] periodic_interval              = 60 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] public_endpoint                = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] publish_errors                 = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] quota_backup_gigabytes         = 1000 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] quota_backups                  = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:14 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] quota_gigabytes                = 1000 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] quota_groups                   = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] quota_snapshots                = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] quota_volumes                  = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] rate_limit_burst               = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] rate_limit_except_level        = CRITICAL {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] rate_limit_interval            = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] reinit_driver_count            = 3 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] replication_device             = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] report_discard_supported       = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] report_interval                = 120 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] reservation_clean_interval     = 86400 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] reservation_expire             = 86400 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] reserved_image_namespaces      = [] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] reserved_percentage            = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] rpc_response_timeout           = 120 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] run_external_periodic_tasks    = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] scst_target_driver             = iscsi {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] scst_target_iqn_name           = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] service_down_time              = 720 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] shell_completion               = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] snapshot_name_template         = snapshot-%s {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] split_loggers                  = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] state_path                     = /opt/stack/data/cinder {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] storage_availability_zone      = nova {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] storage_protocol               = iSCSI {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] syslog_log_facility            = LOG_USER {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] target_helper                  = lioadm {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] target_ip_address              = 192.168.122.192 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] target_port                    = 3260 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] target_protocol                = iscsi {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] target_secondary_ip_addresses  = [] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] trace_flags                    = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] transport_url                  = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] until_refresh                  = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] use_chap_auth                  = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] use_default_quota_class        = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] use_journal                    = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] use_json                       = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] use_multipath_for_image_xfer   = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] use_stderr                     = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] use_syslog                     = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] verify_glance_signatures       = enabled {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] volume_api_class               = cinder.volume.api.API {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] volume_backend_name            = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] volume_clear                   = zero {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] volume_clear_ionice            = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] volume_clear_size              = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] volume_copy_bps_limit          = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] volume_dd_blocksize            = 1M {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] volume_name_template           = volume-%s {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] volume_service_inithost_offload = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] volume_usage_audit_period      = month {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] zoning_mode                    = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_concurrency.disable_process_locking = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.admin_password = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.admin_token = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.admin_user  = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.auth_protocol = https {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.auth_section = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.auth_type   = password {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.auth_uri    = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.auth_version = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.cache       = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.certfile    = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.identity_uri = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.include_service_catalog = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.insecure    = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.interface   = public {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.keyfile     = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_password =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81489) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 28 02:14:15 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.quobyte [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.quobyte [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcache_username =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Running cmd (subprocess): mount.quobyte {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.region_name = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.service_type = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.192/identity {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.backend                  = dogpile.cache.null {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.backend_argument         = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.backend_expiration_time  = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.config_prefix            = cache.oslo {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.debug_cache_backend      = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.enable_retry_client      = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.enable_socket_keepalive  = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.enabled                  = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.enforce_fips_mode        = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.expiration_time          = 600 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.hashclient_retry_attempts = 2 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.memcache_dead_retry      = 300 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.memcache_sasl_enabled    = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.password                 = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.proxies                  = [] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.redis_db                 = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.redis_server             = localhost:6379 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.retry_attempts           = 2 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.retry_delay              = 0.0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.socket_keepalive_count   = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.socket_keepalive_idle    = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.socket_keepalive_interval = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.socket_timeout           = 1.0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.tls_allowed_ciphers      = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.tls_cafile               = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.tls_certfile             = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.tls_enabled              = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.tls_keyfile              = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cache.username                 = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] coordination.backend_url       = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.asyncio_connection    = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.asyncio_slave_connection = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.backend               = sqlalchemy {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.connection            = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.connection_debug      = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.connection_parameters =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.connection_recycle_time = 3600 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.connection_trace      = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.db_inc_retry_interval = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.db_max_retries        = 20 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.db_max_retry_interval = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.db_retry_interval     = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.max_overflow          = 50 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.max_pool_size         = 5 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.max_retries           = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.mysql_wsrep_sync_wait = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.pool_timeout          = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.retry_interval        = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.slave_connection      = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.sqlite_synchronous    = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.synchronous_reader    = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] database.use_db_reconnect      = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler.connection_string     = messaging:// {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler.enabled               = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler.es_doc_type           = notification {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler.es_scroll_size        = 10000 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler.es_scroll_time        = 2m {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler.filter_error_trace    = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler.hmac_keys             = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler.sentinel_service_name = mymaster {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler.socket_timeout        = 0.1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler.trace_requests        = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler.trace_sqlalchemy      = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler_jaeger.process_tags   = {} {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler_jaeger.service_name_prefix = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] profiler_otlp.service_name_prefix = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_policy.enforce_new_defaults = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: WARNING oslo_config.cfg [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_policy.enforce_scope      = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_policy.policy_default_rule = default {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] privsep_osbrick.group          = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] privsep_osbrick.helper_command = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] privsep_osbrick.user           = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cinder_sys_admin.group         = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cinder_sys_admin.helper_command = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] cinder_sys_admin.user          = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] service_user.auth_section      = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] service_user.auth_type         = password {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] service_user.cafile            = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] service_user.certfile          = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] service_user.collect_timing    = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] service_user.insecure          = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] service_user.keyfile           = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] service_user.send_service_user_token = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] service_user.split_loggers     = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] service_user.timeout           = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance.auth_section            = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance.auth_type               = password {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance.certfile                = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack quobyte-client[81502]: Reading configuration file: /etc/quobyte/client.cfg
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance.collect_timing          = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance.insecure                = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance.keyfile                 = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance.region_name             = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack quobyte-client[81502]: Invalid parameters found, error: missing mount point.
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance.split_loggers           = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] glance.timeout                 = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.backend_availability_zone = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack quobyte-client[81502]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.chap_password = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.chap_username =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.disk_geometry = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack quobyte-client[81502]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.driver_client_cert = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.driver_client_cert_key = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.driver_data_namespace = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.driver_use_ssl = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.extra_capabilities = {} {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.filter_function = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.goodness_function = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.iscsi_target_flags =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.iscsi_write_cache = on {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.iser_ip_address = 192.168.122.192 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.iser_port     = 3260 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.nas_host      =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.nas_login     = admin {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.nas_mount_options = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.nas_password  = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.nas_private_key =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.nas_share_path =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.num_shell_tries = 3 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.quobyte_volume_url = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.replication_device = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.report_discard_supported = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.reserved_percentage = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.target_helper = tgtadm {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.target_ip_address = 192.168.122.192 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.target_port   = 3260 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.target_protocol = iscsi {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.trace_flags   = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.unique_fqdn_network = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.use_chap_auth = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.volume_backend_name = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.volume_clear  = zero {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.volume_clear_ionice = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.volume_clear_size = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_reports.file_event_handler = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_reports.log_dir           = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.backend_availability_zone = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.backend_host         = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.chap_password        = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.chap_username        = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.chiscsi_conf         = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.disk_geometry        = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.driver_client_cert   = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.driver_data_namespace = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack sudo[81503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.driver_use_ssl       = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack sudo[81503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.extra_capabilities   = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.filter_function      = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.goodness_function    = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.iser_helper          = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.iser_ip_address      = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.iser_port            = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.iser_target_prefix   = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.nas_host             = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.nas_login            = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.nas_mount_options    = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.nas_password         = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.nas_private_key      = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.nas_share_path       = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.nas_ssh_port         = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.num_shell_tries      = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.nvmet_port_id        = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.replication_device   = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.report_discard_supported = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.reserved_percentage  = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.scst_target_driver   = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.storage_protocol     = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.target_helper        = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.target_ip_address    = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.target_port          = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.target_prefix        = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.target_protocol      = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.trace_flags          = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.use_chap_auth        = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.volume_clear         = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.volume_clear_size    = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] QuobyteHD.volumes_dir          = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_notifications.driver = [] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_notifications.retry = -1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] key_manager.fixed_key          = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.barbican_api_version  = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.barbican_endpoint     = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.barbican_endpoint_type = public {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.barbican_region_name  = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.cafile                = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.certfile              = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.collect_timing        = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.insecure              = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.keyfile               = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.number_of_retries     = 60 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.retry_delay           = 1 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.send_service_user_token = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.split_loggers         = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.timeout               = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.verify_ssl            = True {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican.verify_ssl_path       = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican_service_user.auth_section = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican_service_user.auth_type = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican_service_user.cafile   = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican_service_user.certfile = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican_service_user.collect_timing = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican_service_user.insecure = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican_service_user.keyfile  = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican_service_user.split_loggers = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] barbican_service_user.timeout  = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] vault.approle_role_id          = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] vault.approle_secret_id        = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] vault.kv_mountpoint            = secret {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] vault.kv_path                  = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] vault.kv_version               = 2 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] vault.namespace                = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] vault.root_token_id            = **** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] vault.ssl_ca_crt_file          = None {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] vault.timeout                  = 60.0 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] vault.use_ssl                  = False {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 28 02:14:15 devstack cinder-volume[81280]: DEBUG oslo_service.backend._eventlet.service [None req-8fe0230b-c6df-4ea7-890b-e92744ae13f0 None None] ******************************************************************************** {{(pid=81280) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 28 02:14:15 devstack sudo[81503]: pam_unix(sudo:session): session closed for user root
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.424s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:14:15 devstack cinder-volume[81489]: INFO cinder.volume.driver [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Driver hasn't implemented _init_vendor_properties()
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG cinder.volume.driver [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732765197754, 'free_capacity_gb': 1775.732765197754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81489) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG oslo_db.sqlalchemy.engines [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81489) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writer thread running {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG cinder.db.sqlalchemy.api [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Building query based on filter {{(pid=81489) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81489) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:14:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:14:15 devstack cinder-volume[81489]: INFO cinder.keymgr.migration [None req-bc1ed145-350d-4bfe-902a-f9d47fb8a64f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 28 02:14:15 devstack sudo[81519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:14:15 devstack sudo[81519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:14:16 devstack sudo[81519]: pam_unix(sudo:session): session closed for user root
Apr 28 02:14:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.403s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:14:16 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:14:16 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Driver initialization completed successfully.
Apr 28 02:14:16 devstack cinder-volume[81489]: INFO cinder.manager [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Initiating service 3 cleanup
Apr 28 02:14:16 devstack cinder-volume[81489]: INFO cinder.manager [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Service 3 cleanup completed.
Apr 28 02:14:16 devstack cinder-volume[81489]: DEBUG cinder.service [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Creating RPC server for service cinder-volume {{(pid=81489) start /opt/stack/cinder/cinder/service.py:231}}
Apr 28 02:14:16 devstack cinder-volume[81489]: DEBUG cinder.service [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81489) start /opt/stack/cinder/cinder/service.py:237}}
Apr 28 02:14:16 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 28 02:14:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:14:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:14:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:14:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:14:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:14:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:14:16 devstack sudo[81525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:14:16 devstack sudo[81525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:14:16 devstack sudo[81525]: pam_unix(sudo:session): session closed for user root
Apr 28 02:14:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.435s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:14:16 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-13999c1a-5505-4a69-a8b3-f4b9eb9c0c9a None None] Driver post RPC initialization completed successfully.
Apr 28 02:14:24 devstack cinder-volume[81280]: DEBUG dbcounter [-] [81280] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81280) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:14:26 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=2 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:14:26 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:15:14 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:15:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Flow 'volume_create_manager' (3e9dac55-2518-48dd-bd87-c4e391b6a557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:15:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02a983d-8f21-4401-ac23-cb4bafaca76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02a983d-8f21-4401-ac23-cb4bafaca76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1845834392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34607d46-3ed9-4dfd-a678-71d84cf3d231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9367304ac3e243c580bafb2c1979d043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:15:15Z,use_quota=True,user_id='6f9be967b1cc47b8a55600bb4821497e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbc63c1-f4aa-47da-91b7-0522a19c6f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cbc63c1-f4aa-47da-91b7-0522a19c6f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430b0cae-d770-49bc-a292-8be034c4e3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430b0cae-d770-49bc-a292-8be034c4e3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34607d46-3ed9-4dfd-a678-71d84cf3d231', 'volume_name': 'volume-34607d46-3ed9-4dfd-a678-71d84cf3d231', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768d59c6-5759-4f4f-b0f7-ca1cf0990f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768d59c6-5759-4f4f-b0f7-ca1cf0990f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ef6c17-8c82-402c-aba4-053f7aa20fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:15 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Volume 34607d46-3ed9-4dfd-a678-71d84cf3d231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34607d46-3ed9-4dfd-a678-71d84cf3d231', 'volume_size': 1}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1845834392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34607d46-3ed9-4dfd-a678-71d84cf3d231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9367304ac3e243c580bafb2c1979d043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:15:15Z,use_quota=True,user_id='6f9be967b1cc47b8a55600bb4821497e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Creating volume 34607d46-3ed9-4dfd-a678-71d84cf3d231 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:15:15 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:15:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:15 devstack sudo[81883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231 1073741824
Apr 28 02:15:15 devstack sudo[81883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:16 devstack sudo[81883]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231 1073741824" returned: 0 in 1.294s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:16 devstack sudo[82208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231
Apr 28 02:15:16 devstack sudo[82208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:17 devstack sudo[82208]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231" returned: 0 in 1.160s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] <== create_volume: return (2541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:15:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.545s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ef6c17-8c82-402c-aba4-053f7aa20fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34607d46-3ed9-4dfd-a678-71d84cf3d231', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42356504-8bf7-4ce7-9868-aa978f47f485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:17 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Volume volume-34607d46-3ed9-4dfd-a678-71d84cf3d231 (34607d46-3ed9-4dfd-a678-71d84cf3d231): created successfully
Apr 28 02:15:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42356504-8bf7-4ce7-9868-aa978f47f485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Flow 'volume_create_manager' (3e9dac55-2518-48dd-bd87-c4e391b6a557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:15:17 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-d76b83f6-a774-4f91-9962-b2060e8f9241 req-379b8f31-148c-492f-b4c8-7284bd1027b7 tempest-VolumesSnapshotsTestJSON-823421485 None] Created volume successfully.
Apr 28 02:15:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Creating offline snapshot ab447d49-d71e-4952-a105-3ae9725ba203 of volume 34607d46-3ed9-4dfd-a678-71d84cf3d231 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:15:19 devstack cinder-volume[81489]: INFO oslo.privsep.daemon [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1ltw_cqe/privsep.sock']
Apr 28 02:15:19 devstack sudo[82233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1ltw_cqe/privsep.sock
Apr 28 02:15:19 devstack sudo[82233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:19 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 28 02:15:19 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 28 02:15:19 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 28 02:15:19 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 28 02:15:19 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 28 02:15:19 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 28 02:15:19 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 28 02:15:19 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 28 02:15:19 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 28 02:15:20 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 28 02:15:20 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 28 02:15:20 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 28 02:15:20 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 28 02:15:20 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 28 02:15:20 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 28 02:15:20 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 28 02:15:20 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 28 02:15:20 devstack cinder-volume[81489]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 28 02:15:21 devstack sudo[82233]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:21 devstack cinder-volume[81489]: INFO oslo.privsep.daemon [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Spawned new privsep daemon via rootwrap
Apr 28 02:15:21 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Accepted privsep connection to /tmp/tmp1ltw_cqe/privsep.sock {{(pid=81489) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 28 02:15:21 devstack cinder-volume[81489]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 28 02:15:21 devstack cinder-volume[81489]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 28 02:15:21 devstack cinder-volume[81489]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 28 02:15:21 devstack cinder-volume[81489]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82246
Apr 28 02:15:21 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e6bef5-0055-4f39-84f5-dd1781dabb25]: (2,) {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:15:21 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5002fdcb-cd24-4a55-a375-cb3b71caa71c]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:15:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:21 devstack sudo[82276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231
Apr 28 02:15:21 devstack sudo[82276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:22 devstack sudo[82276]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231" returned: 0 in 1.013s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:22 devstack sudo[82296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203 1G
Apr 28 02:15:22 devstack sudo[82296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:24 devstack sudo[82296]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203 1G" returned: 0 in 1.601s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34607d46-3ed9-4dfd-a678-71d84cf3d231 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:24 devstack sudo[82382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34607d46-3ed9-4dfd-a678-71d84cf3d231 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203
Apr 28 02:15:24 devstack sudo[82382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:25 devstack sudo[82382]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34607d46-3ed9-4dfd-a678-71d84cf3d231 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203" returned: 0 in 1.256s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:25 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203 is being set with open permissions: ugo+rw
Apr 28 02:15:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:25 devstack sudo[82390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203
Apr 28 02:15:25 devstack sudo[82390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:26 devstack sudo[82390]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203" returned: 0 in 0.987s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:26 devstack sudo[82394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.info
Apr 28 02:15:26 devstack sudo[82394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:27 devstack sudo[82394]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.info" returned: 0 in 0.803s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:27 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.info is being set with open permissions: ugo+rw
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:27 devstack sudo[82402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.info
Apr 28 02:15:27 devstack sudo[82402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Flow 'volume_create_manager' (0899eb31-6506-4500-80ef-5db69caac2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107f9e82-d8ee-45bc-b967-ddb99d555b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107f9e82-d8ee-45bc-b967-ddb99d555b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1766573687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c005bbae-f3ee-4d87-89b6-c429a041fa6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdbbb9c7c0454c9693e51f2b264ffd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:15:27Z,use_quota=True,user_id='7eb92b8be4d540639fa616fb6f93336d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a9efd4-409d-4b9b-989c-1d0f0f3f22cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a9efd4-409d-4b9b-989c-1d0f0f3f22cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319e2b08-9bbd-45fd-b16d-53bec61369d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319e2b08-9bbd-45fd-b16d-53bec61369d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c005bbae-f3ee-4d87-89b6-c429a041fa6b', 'volume_name': 'volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946ee666-02f0-4835-b494-d073e7fdfe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946ee666-02f0-4835-b494-d073e7fdfe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f45d88f-ef69-4e49-8a13-8a1b17ee4126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:27 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Volume c005bbae-f3ee-4d87-89b6-c429a041fa6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b', 'volume_size': 1}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:27 devstack sudo[82402]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.info" returned: 0 in 0.817s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.852s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1766573687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c005bbae-f3ee-4d87-89b6-c429a041fa6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdbbb9c7c0454c9693e51f2b264ffd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:15:27Z,use_quota=True,user_id='7eb92b8be4d540639fa616fb6f93336d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Creating volume c005bbae-f3ee-4d87-89b6-c429a041fa6b {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:15:27 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:15:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:28 devstack sudo[82405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b 1073741824
Apr 28 02:15:28 devstack sudo[82405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:28 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-c633bcef-c9c4-4674-87ae-ea5a7366edaf req-38e7ebc5-0deb-4387-9c08-42db20db0ebe tempest-VolumesSnapshotsTestJSON-823421485 None] Create snapshot completed successfully
Apr 28 02:15:28 devstack sudo[82405]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Acquiring lock "cinder-ab447d49-d71e-4952-a105-3ae9725ba203-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:15:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b 1073741824" returned: 0 in 0.877s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "cinder-ab447d49-d71e-4952-a105-3ae9725ba203-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:15:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Acquiring lock "cinder-quobyte-34607d46-3ed9-4dfd-a678-71d84cf3d231" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:15:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "cinder-quobyte-34607d46-3ed9-4dfd-a678-71d84cf3d231" acquired by "delete_snapshot" :: waited 0.049s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:15:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Acquiring lock "cinder-quobyte-ab447d49-d71e-4952-a105-3ae9725ba203" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:15:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:29 devstack sudo[82410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b
Apr 28 02:15:29 devstack sudo[82410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "cinder-quobyte-ab447d49-d71e-4952-a105-3ae9725ba203" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:15:29 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Deleting offline snapshot ab447d49-d71e-4952-a105-3ae9725ba203 of volume 34607d46-3ed9-4dfd-a678-71d84cf3d231 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:15:29 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] snapshot_file for this snap is: volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:15:29 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a55152-45fb-4435-a4c2-b07438ab8581]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:15:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:29 devstack sudo[82412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203
Apr 28 02:15:29 devstack sudo[82412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:29 devstack sudo[82410]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b" returned: 0 in 0.712s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:29 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:15:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f45d88f-ef69-4e49-8a13-8a1b17ee4126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296a263b-ec67-4bf1-87e4-0178008f29ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:29 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Volume volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b (c005bbae-f3ee-4d87-89b6-c429a041fa6b): created successfully
Apr 28 02:15:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (296a263b-ec67-4bf1-87e4-0178008f29ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Flow 'volume_create_manager' (0899eb31-6506-4500-80ef-5db69caac2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:15:29 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-bf77c364-e989-453b-bd31-53d4dc25d6ae tempest-VolumesAdminNegativeTest-1522030841 None] Created volume successfully.
Apr 28 02:15:30 devstack sudo[82412]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203" returned: 0 in 1.092s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34607d46-3ed9-4dfd-a678-71d84cf3d231(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:15:30 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e32e05-f294-45b4-9912-9c9cf5a11b1d]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:15:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:30 devstack sudo[82418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231
Apr 28 02:15:30 devstack sudo[82418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Acquiring lock "cinder-c005bbae-f3ee-4d87-89b6-c429a041fa6b-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:15:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Lock "cinder-c005bbae-f3ee-4d87-89b6-c429a041fa6b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:15:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Acquiring lock "cinder-quobyte-c005bbae-f3ee-4d87-89b6-c429a041fa6b" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:15:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Lock "cinder-quobyte-c005bbae-f3ee-4d87-89b6-c429a041fa6b" acquired by "delete_volume" :: waited 0.032s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:15:31 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[65319818-da16-4b39-864e-2b69589676d9]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:15:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:31 devstack sudo[82418]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231" returned: 0 in 1.187s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:31 devstack sudo[82431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203
Apr 28 02:15:31 devstack sudo[82431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:31 devstack sudo[82430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b
Apr 28 02:15:31 devstack sudo[82430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:32 devstack sudo[82431]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203" returned: 0 in 0.748s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:32 devstack sudo[82445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203
Apr 28 02:15:32 devstack sudo[82445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:32 devstack sudo[82430]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b" returned: 0 in 1.045s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:32 devstack sudo[82447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b
Apr 28 02:15:32 devstack sudo[82447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:32 devstack sudo[82447]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c005bbae-f3ee-4d87-89b6-c429a041fa6b" returned: 0 in 0.515s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Lock "cinder-quobyte-c005bbae-f3ee-4d87-89b6-c429a041fa6b" released by "delete_volume" :: held 1.644s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:15:32 devstack cinder-volume[81489]: WARNING cinder.quota [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:15:32 devstack cinder-volume[81489]: WARNING cinder.quota [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:15:32 devstack sudo[82445]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231.ab447d49-d71e-4952-a105-3ae9725ba203" returned: 0 in 0.786s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Created reservations ['cb6843ac-8ae6-4fc2-ae8e-671969210fdb', '56ed28e5-1ce3-4daf-9ce1-4bc85c2de54f', '220f5086-d554-4867-8238-f9e04464d6af', '3d6335a1-47c2-4d52-9f96-4cfea44cf5de'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "cinder-quobyte-ab447d49-d71e-4952-a105-3ae9725ba203" released by "_delete_snapshot" :: held 4.022s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "cinder-quobyte-34607d46-3ed9-4dfd-a678-71d84cf3d231" released by "delete_snapshot" :: held 4.109s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:15:33 devstack cinder-volume[81489]: WARNING cinder.quota [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG cinder.quota [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Created reservations ['16f77db9-f04a-430b-9e7e-e19cbf6a9c8a', '191612ff-f00b-49a1-ad30-8519fbad33aa', '5f1913ec-9ceb-43ea-9d66-2c58940c527e', '9f3dfdcb-07df-4cff-af9b-c5373a2f2b1b'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:33 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Delete snapshot completed successfully.
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-89697245-d585-43a0-be3d-52ce379048e8 req-d86a097f-e62d-46d4-b06d-cd52ef9366f3 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "cinder-ab447d49-d71e-4952-a105-3ae9725ba203-delete_snapshot" released by "delete_snapshot" :: held 4.354s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:15:33 devstack sudo[82452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:15:33 devstack sudo[82452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Acquiring lock "cinder-34607d46-3ed9-4dfd-a678-71d84cf3d231-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "cinder-34607d46-3ed9-4dfd-a678-71d84cf3d231-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Acquiring lock "cinder-quobyte-34607d46-3ed9-4dfd-a678-71d84cf3d231" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "cinder-quobyte-34607d46-3ed9-4dfd-a678-71d84cf3d231" acquired by "delete_volume" :: waited 0.027s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[238269f6-ca8a-4dd6-b113-d76046d23c13]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:15:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:33 devstack sudo[82455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231
Apr 28 02:15:33 devstack sudo[82455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:34 devstack sudo[82452]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.166s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:34 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:15:34 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Deleted volume successfully.
Apr 28 02:15:34 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-92bd57db-b60b-44c4-949c-3003ad995da6 tempest-VolumesAdminNegativeTest-1522030841 None] Lock "cinder-c005bbae-f3ee-4d87-89b6-c429a041fa6b-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:15:34 devstack sudo[82455]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231" returned: 0 in 0.883s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:34 devstack sudo[82464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231
Apr 28 02:15:34 devstack sudo[82464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:35 devstack sudo[82464]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34607d46-3ed9-4dfd-a678-71d84cf3d231" returned: 0 in 0.774s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "cinder-quobyte-34607d46-3ed9-4dfd-a678-71d84cf3d231" released by "delete_volume" :: held 1.752s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:15:35 devstack cinder-volume[81489]: DEBUG cinder.quota [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Created reservations ['c925bcef-1967-40e5-a163-5f8b9e795106', '386b6928-1c3e-4e52-9aab-a58cefcc1a90', '6edb05a5-2a65-4dcc-9934-dcda5ea26b5e', '3fcdd11f-a2ec-43dd-864f-b4b7af56a6a8'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:15:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:15:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:15:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:35 devstack sudo[82491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:15:35 devstack sudo[82491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:36 devstack sudo[82491]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.823s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:36 devstack cinder-volume[81489]: DEBUG cinder.manager [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:15:36 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Deleted volume successfully.
Apr 28 02:15:36 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-b76d72ce-84b1-48a4-b81f-849f5aaf6df2 req-d3ed96e6-ac1e-4ec9-a796-f5a64743d564 tempest-VolumesSnapshotsTestJSON-823421485 None] Lock "cinder-34607d46-3ed9-4dfd-a678-71d84cf3d231-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Flow 'volume_create_manager' (28407176-9c80-4080-898c-11e8a469e74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67cc033b-141f-40f2-8dc8-655fef5dcdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67cc033b-141f-40f2-8dc8-655fef5dcdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:15:38Z,deleted=False,deleted_at=None,display_description='',display_name='7fe26547-cd00-4e17-ad0c-b970e2f2d330-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5636af77-084d-48af-9e3f-2c1ab6305b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b10af974cb45e3adfd1829c4aac446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:15:38Z,use_quota=True,user_id='0ae0afab83f3411dbe41014e4cdd529d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4ff47c-35fe-4642-a059-66395d098a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4ff47c-35fe-4642-a059-66395d098a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a3bd27-5eb2-49c2-9441-5454d29f963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a3bd27-5eb2-49c2-9441-5454d29f963a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5636af77-084d-48af-9e3f-2c1ab6305b32', 'volume_name': 'volume-5636af77-084d-48af-9e3f-2c1ab6305b32', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d68670-bac4-4e88-a45a-03c8a7d7e270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d68670-bac4-4e88-a45a-03c8a7d7e270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7e2e96-042f-43f4-89f3-7460bbc7bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:38 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Volume 5636af77-084d-48af-9e3f-2c1ab6305b32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5636af77-084d-48af-9e3f-2c1ab6305b32', 'volume_size': 1}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:15:38Z,deleted=False,deleted_at=None,display_description='',display_name='7fe26547-cd00-4e17-ad0c-b970e2f2d330-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5636af77-084d-48af-9e3f-2c1ab6305b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b10af974cb45e3adfd1829c4aac446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:15:38Z,use_quota=True,user_id='0ae0afab83f3411dbe41014e4cdd529d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Creating volume 5636af77-084d-48af-9e3f-2c1ab6305b32 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:15:38 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:15:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:38 devstack sudo[82503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32 1073741824
Apr 28 02:15:38 devstack sudo[82503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:39 devstack sudo[82503]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32 1073741824" returned: 0 in 0.972s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:39 devstack sudo[82508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32
Apr 28 02:15:39 devstack sudo[82508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:39 devstack sudo[82508]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32" returned: 0 in 0.638s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:15:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:39 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7e2e96-042f-43f4-89f3-7460bbc7bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5636af77-084d-48af-9e3f-2c1ab6305b32', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:39 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524a0b49-8290-4f78-9f5a-acb0a6316368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:39 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Volume volume-5636af77-084d-48af-9e3f-2c1ab6305b32 (5636af77-084d-48af-9e3f-2c1ab6305b32): created successfully
Apr 28 02:15:39 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524a0b49-8290-4f78-9f5a-acb0a6316368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:39 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Flow 'volume_create_manager' (28407176-9c80-4080-898c-11e8a469e74b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:15:39 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-404136af-bb10-4000-b278-736541701f6a tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Created volume successfully.
Apr 28 02:15:42 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d0805c8d-d557-4f6a-b825-7fc4d32121c5 tempest-GroupsV314Test-968680091 None] Group tempest-GroupsV314Test-Group-434256608: creating
Apr 28 02:15:42 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d0805c8d-d557-4f6a-b825-7fc4d32121c5 tempest-GroupsV314Test-968680091 None] Group tempest-GroupsV314Test-Group-434256608: created successfully
Apr 28 02:15:42 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d0805c8d-d557-4f6a-b825-7fc4d32121c5 tempest-GroupsV314Test-968680091 None] Create group completed successfully.
Apr 28 02:15:43 devstack cinder-volume[81489]: WARNING py.warnings [req-38c6ac17-fead-4954-b898-92847261c543 req-af85c41e-546a-4603-a27c-dbec9f5c7cbd tempest-ServerBootFromVolumeStableRescueTest-752561324 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Apr 28 02:15:43 devstack cinder-volume[81489]:   .first()
Apr 28 02:15:43 devstack cinder-volume[81489]: 
Apr 28 02:15:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-38c6ac17-fead-4954-b898-92847261c543 req-af85c41e-546a-4603-a27c-dbec9f5c7cbd tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-38c6ac17-fead-4954-b898-92847261c543 req-af85c41e-546a-4603-a27c-dbec9f5c7cbd tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:43 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7df6b7c-a9fe-4c09-8fc3-b35391cd78ae]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:15:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-38c6ac17-fead-4954-b898-92847261c543 req-af85c41e-546a-4603-a27c-dbec9f5c7cbd tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:43 devstack sudo[82562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32
Apr 28 02:15:43 devstack sudo[82562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:43 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Flow 'volume_create_manager' (5ecba55f-f146-4906-b6a8-3b5f8b4aeb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7854cf3-aca3-4808-9717-142a7058138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7854cf3-aca3-4808-9717-142a7058138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-827170091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1021c950-7a5b-4c84-8ddf-b3640440af83,host='devstack@QuobyteHD#QuobyteHD',id=ffa46bcc-92a1-489f-b953-2e47d6bbcf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4de7246304f4925b7475c1ad1286cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:15:44Z,use_quota=True,user_id='a2fd4e47d2224dac9e0157adcca61495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a15a5e3b-487b-44d9-97af-883cd23144fd),volume_type_id=a15a5e3b-487b-44d9-97af-883cd23144fd)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f6456b-2697-4555-a714-a49af2ca54d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f6456b-2697-4555-a714-a49af2ca54d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd2e867-9c58-4801-bf6a-31040d572dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd2e867-9c58-4801-bf6a-31040d572dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa46bcc-92a1-489f-b953-2e47d6bbcf50', 'volume_name': 'volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c31fa08-cdf9-4c2b-aa22-8aac25463d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c31fa08-cdf9-4c2b-aa22-8aac25463d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96aeeb4-b330-4b24-949e-3809b2566f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:44 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Volume ffa46bcc-92a1-489f-b953-2e47d6bbcf50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50', 'volume_size': 1}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:44 devstack sudo[82562]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-38c6ac17-fead-4954-b898-92847261c543 req-af85c41e-546a-4603-a27c-dbec9f5c7cbd tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32" returned: 0 in 0.831s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-38c6ac17-fead-4954-b898-92847261c543 req-af85c41e-546a-4603-a27c-dbec9f5c7cbd tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.888s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.102s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1021c950-7a5b-4c84-8ddf-b3640440af83,created_at=2026-04-28T00:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-827170091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1021c950-7a5b-4c84-8ddf-b3640440af83,host='devstack@QuobyteHD#QuobyteHD',id=ffa46bcc-92a1-489f-b953-2e47d6bbcf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4de7246304f4925b7475c1ad1286cb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:15:44Z,use_quota=True,user_id='a2fd4e47d2224dac9e0157adcca61495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a15a5e3b-487b-44d9-97af-883cd23144fd),volume_type_id=a15a5e3b-487b-44d9-97af-883cd23144fd)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Creating volume ffa46bcc-92a1-489f-b953-2e47d6bbcf50 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:15:44 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:44 devstack sudo[82569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 1073741824
Apr 28 02:15:44 devstack sudo[82569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-af85c41e-546a-4603-a27c-dbec9f5c7cbd tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499', 'name': 'volume-5636af77-084d-48af-9e3f-2c1ab6305b32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf802b93-caab-4e5e-a391-6881c3be0a2b', 'enforce_multipath': True} {{(pid=81489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 28 02:15:44 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-38c6ac17-fead-4954-b898-92847261c543 req-af85c41e-546a-4603-a27c-dbec9f5c7cbd tempest-ServerBootFromVolumeStableRescueTest-752561324 None] attachment_update completed successfully.
Apr 28 02:15:45 devstack sudo[82569]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 1073741824" returned: 0 in 0.773s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:45 devstack sudo[82575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50
Apr 28 02:15:45 devstack sudo[82575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:45 devstack sudo[82575]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50" returned: 0 in 0.634s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:15:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:45 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f161d0aa-a70c-4669-b6a2-33b0d2cca890 tempest-GroupsTest-16438842 None] Group tempest-Group1-2104752926: creating
Apr 28 02:15:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96aeeb4-b330-4b24-949e-3809b2566f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30da2631-b7a9-4c53-ac94-c49068616656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:45 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Volume volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 (ffa46bcc-92a1-489f-b953-2e47d6bbcf50): created successfully
Apr 28 02:15:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30da2631-b7a9-4c53-ac94-c49068616656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Flow 'volume_create_manager' (5ecba55f-f146-4906-b6a8-3b5f8b4aeb08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:15:45 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f161d0aa-a70c-4669-b6a2-33b0d2cca890 tempest-GroupsTest-16438842 None] Group tempest-Group1-2104752926: created successfully
Apr 28 02:15:45 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3ca521ac-1c9f-4cee-bbdb-2e9d878d063a tempest-GroupsV314Test-968680091 None] Created volume successfully.
Apr 28 02:15:45 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f161d0aa-a70c-4669-b6a2-33b0d2cca890 tempest-GroupsTest-16438842 None] Create group completed successfully.
Apr 28 02:15:47 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-17ef9bfd-b389-4c04-ac90-660a953887b9 tempest-GroupsTest-16438842 None] Group tempest-Group2-1957561391: creating
Apr 28 02:15:47 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-17ef9bfd-b389-4c04-ac90-660a953887b9 tempest-GroupsTest-16438842 None] Group tempest-Group2-1957561391: created successfully
Apr 28 02:15:47 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-17ef9bfd-b389-4c04-ac90-660a953887b9 tempest-GroupsTest-16438842 None] Create group completed successfully.
Apr 28 02:15:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:47 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Cloning volume ffa46bcc-92a1-489f-b953-2e47d6bbcf50 to volume 37b6a49f-d3fe-4f31-ad79-4c49844f59d1
Apr 28 02:15:47 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Creating offline snapshot 788b5f4c-3438-4737-b92a-a03ae6dd9bf2 of volume ffa46bcc-92a1-489f-b953-2e47d6bbcf50 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:15:47 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7f4b8c-a2c7-437f-a60c-148f253bc880]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:15:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:47 devstack sudo[82649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50
Apr 28 02:15:47 devstack sudo[82649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:47 devstack sudo[82649]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50" returned: 0 in 0.582s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:47 devstack sudo[82654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2 1G
Apr 28 02:15:47 devstack sudo[82654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Flow 'volume_create_manager' (1d0c75a5-5aea-4665-be15-b880c0a312d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e78b33-f0ba-44f5-841a-0c2c12722304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e78b33-f0ba-44f5-841a-0c2c12722304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1325825452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8ecb135c-4163-4ee4-ab9b-45b75a54374f,host='devstack@QuobyteHD#QuobyteHD',id=d8e07c86-d463-4b4a-a19f-778fe0feb11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477963181cc84567b0a91184202c42aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:15:49Z,use_quota=True,user_id='fb617e2e7daf4612ac3cb4b596e012a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(962ed126-9052-42bc-b3da-5e90e4d84669),volume_type_id=962ed126-9052-42bc-b3da-5e90e4d84669)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1274a23-53d1-4f0c-b2cc-b9c3315abe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1274a23-53d1-4f0c-b2cc-b9c3315abe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1828b13-b13a-4e2b-9adf-1625e5958423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1828b13-b13a-4e2b-9adf-1625e5958423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8e07c86-d463-4b4a-a19f-778fe0feb11f', 'volume_name': 'volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74840e1-2f8e-45e0-8a2e-edbcb872f743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74840e1-2f8e-45e0-8a2e-edbcb872f743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:15:48 devstack sudo[82654]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b463c7e-5bf0-487a-8f46-4bed1c6c3d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:15:48 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Volume d8e07c86-d463-4b4a-a19f-778fe0feb11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f', 'volume_size': 1}
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2 1G" returned: 0 in 0.792s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:48 devstack sudo[82664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2
Apr 28 02:15:48 devstack sudo[82664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:49 devstack sudo[82664]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2" returned: 0 in 0.486s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:49 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2 is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:15:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:49 devstack sudo[82669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2
Apr 28 02:15:49 devstack sudo[82669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:49 devstack sudo[82669]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2" returned: 0 in 0.584s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:49 devstack sudo[82988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.info
Apr 28 02:15:49 devstack sudo[82988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:50 devstack sudo[82988]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.info" returned: 0 in 0.573s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:50 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:15:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:50 devstack sudo[82997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.info
Apr 28 02:15:50 devstack sudo[82997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:51 devstack sudo[82997]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.info" returned: 0 in 0.658s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Acquiring lock "cinder-quobyte-37b6a49f-d3fe-4f31-ad79-4c49844f59d1" by "_copy_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Lock "cinder-quobyte-37b6a49f-d3fe-4f31-ad79-4c49844f59d1" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] snapshot: 788b5f4c-3438-4737-b92a-a03ae6dd9bf2, volume: 37b6a49f-d3fe-4f31-ad79-4c49844f59d1,  {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd42d79d-4ded-4bec-9d68-f639a867245d]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:51 devstack sudo[83021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2
Apr 28 02:15:51 devstack sudo[83021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:51 devstack sudo[83021]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2" returned: 0 in 0.738s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Creating direct copy from snapshot {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaf379c-743b-41d3-9c26-cdf725f1707a]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:15:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:52 devstack sudo[83043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50
Apr 28 02:15:52 devstack sudo[83043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:15:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:15:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:15:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:15:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:15:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:15:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:52 devstack sudo[83046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:15:52 devstack sudo[83046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:52 devstack sudo[83043]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50" returned: 0 in 0.840s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:52 devstack cinder-volume[81489]: DEBUG cinder.utils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Path /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1 not found in is_blk_device check {{(pid=81489) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 02:15:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:52 devstack sudo[83052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1
Apr 28 02:15:52 devstack sudo[83052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:15:53 devstack sudo[83046]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.711s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:15:59 devstack sudo[83052]: pam_unix(sudo:session): session closed for user root
Apr 28 02:15:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1" returned: 0 in 6.930s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:15:59 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4b2e28-aad1-41de-9eb7-3ae1ae85c6eb]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:15:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:15:59 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=45,cinder:UPDATE=42,cinder:DELETE=5,cinder:INSERT=3 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:15:59 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:UPDATE=39,cinder:SELECT=42,cinder:INSERT=16,cinder:DELETE=2 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:15:59 devstack sudo[83086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50
Apr 28 02:15:59 devstack sudo[83086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:00 devstack sudo[83086]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50" returned: 0 in 0.751s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:00 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1 {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:16:00 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Converted 1024.00 MB image at 147.69 MB/s
Apr 28 02:16:00 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1 is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:16:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:00 devstack sudo[83092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1
Apr 28 02:16:00 devstack sudo[83092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:01 devstack sudo[83092]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1" returned: 0 in 0.484s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Lock "cinder-quobyte-37b6a49f-d3fe-4f31-ad79-4c49844f59d1" released by "_copy_volume_from_snapshot" :: held 9.870s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:16:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Acquiring lock "cinder-quobyte-788b5f4c-3438-4737-b92a-a03ae6dd9bf2" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:16:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Lock "cinder-quobyte-788b5f4c-3438-4737-b92a-a03ae6dd9bf2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:16:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Deleting offline snapshot 788b5f4c-3438-4737-b92a-a03ae6dd9bf2 of volume ffa46bcc-92a1-489f-b953-2e47d6bbcf50 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:16:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] snapshot_file for this snap is: volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:16:01 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6618c01-e7d7-4233-bcec-e02cc7124b91]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:01 devstack sudo[83095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2
Apr 28 02:16:01 devstack sudo[83095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:02 devstack sudo[83095]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2" returned: 0 in 0.932s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:16:02 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7894aa55-3d74-4a3c-85df-4fe96ec6d528]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:02 devstack sudo[83127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50
Apr 28 02:16:02 devstack sudo[83127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:02 devstack sudo[83127]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50" returned: 0 in 0.615s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:02 devstack sudo[83132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2
Apr 28 02:16:02 devstack sudo[83132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:03 devstack sudo[83132]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2" returned: 0 in 0.645s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:03 devstack sudo[83137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2
Apr 28 02:16:03 devstack sudo[83137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:03 devstack sudo[83137]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50.788b5f4c-3438-4737-b92a-a03ae6dd9bf2" returned: 0 in 0.526s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Lock "cinder-quobyte-788b5f4c-3438-4737-b92a-a03ae6dd9bf2" released by "_delete_snapshot" :: held 2.832s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.642s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.193s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8ecb135c-4163-4ee4-ab9b-45b75a54374f,created_at=2026-04-28T00:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1325825452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8ecb135c-4163-4ee4-ab9b-45b75a54374f,host='devstack@QuobyteHD#QuobyteHD',id=d8e07c86-d463-4b4a-a19f-778fe0feb11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477963181cc84567b0a91184202c42aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:15:49Z,use_quota=True,user_id='fb617e2e7daf4612ac3cb4b596e012a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(962ed126-9052-42bc-b3da-5e90e4d84669),volume_type_id=962ed126-9052-42bc-b3da-5e90e4d84669)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Creating volume d8e07c86-d463-4b4a-a19f-778fe0feb11f {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:16:03 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:16:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:04 devstack sudo[83153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f 1073741824
Apr 28 02:16:04 devstack sudo[83153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:04 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-fe510269-33be-45c9-a02e-9579eee50ef8 tempest-GroupsV314Test-968680091 None] Create group from source-group-1021c950-7a5b-4c84-8ddf-b3640440af83 completed successfully.
Apr 28 02:16:04 devstack sudo[83153]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f 1073741824" returned: 0 in 0.727s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:04 devstack sudo[83163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f
Apr 28 02:16:04 devstack sudo[83163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:05 devstack sudo[83163]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f" returned: 0 in 0.547s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:16:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b463c7e-5bf0-487a-8f46-4bed1c6c3d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218738de-c8e6-44e0-968c-9d1044d9bd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:05 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Volume volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f (d8e07c86-d463-4b4a-a19f-778fe0feb11f): created successfully
Apr 28 02:16:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218738de-c8e6-44e0-968c-9d1044d9bd51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Flow 'volume_create_manager' (1d0c75a5-5aea-4665-be15-b880c0a312d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:05 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-38a3d9f6-f7c1-43b5-a465-897fdb9c93cf tempest-GroupsTest-16438842 None] Created volume successfully.
Apr 28 02:16:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Acquiring lock "cinder-quobyte-37b6a49f-d3fe-4f31-ad79-4c49844f59d1" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:16:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Lock "cinder-quobyte-37b6a49f-d3fe-4f31-ad79-4c49844f59d1" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:16:05 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c433103-903e-443f-904e-3d2ed9a45fe7]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:05 devstack sudo[83166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1
Apr 28 02:16:05 devstack sudo[83166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:06 devstack sudo[83166]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1" returned: 0 in 0.638s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:06 devstack sudo[83171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1
Apr 28 02:16:06 devstack sudo[83171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Acquiring lock "cinder-quobyte-d8e07c86-d463-4b4a-a19f-778fe0feb11f" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:16:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Lock "cinder-quobyte-d8e07c86-d463-4b4a-a19f-778fe0feb11f" acquired by "delete_volume" :: waited 0.027s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:16:06 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37bf0d4-5647-49f0-bea9-bef6f41e7e09]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:06 devstack sudo[83171]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-37b6a49f-d3fe-4f31-ad79-4c49844f59d1" returned: 0 in 0.653s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Lock "cinder-quobyte-37b6a49f-d3fe-4f31-ad79-4c49844f59d1" released by "delete_volume" :: held 1.341s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:16:06 devstack sudo[83176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f
Apr 28 02:16:06 devstack sudo[83176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:06 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Created reservations ['03b9c927-d43d-4312-b996-754c7716140c'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:16:06 devstack cinder-volume[81489]: WARNING cinder.quota [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-82126933 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-82126933, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:16:06 devstack cinder-volume[81489]: WARNING cinder.quota [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-82126933 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-82126933, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:16:06 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Created reservations ['9ba395bd-c2ca-4c17-b6d8-a0bbb60b00f4', '27655c67-3008-4772-9a61-403da440b96a', '54dad335-1547-4ec1-a48e-ac1d248a4a25', '256cd57c-5c26-42cf-8381-e311bc5bf746'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:16:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:07 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:07 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:07 devstack sudo[83203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:16:07 devstack sudo[83203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:07 devstack sudo[83176]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f" returned: 0 in 0.807s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:07 devstack sudo[83208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f
Apr 28 02:16:07 devstack sudo[83208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:07 devstack sudo[83203]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.682s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:07 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:16:07 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-920cec82-d812-430d-8965-354b2a7677ae tempest-GroupsV314Test-968680091 None] Delete group completed successfully.
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Acquiring lock "cinder-quobyte-ffa46bcc-92a1-489f-b953-2e47d6bbcf50" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Lock "cinder-quobyte-ffa46bcc-92a1-489f-b953-2e47d6bbcf50" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f8b3b3-9cbb-4d6c-95b5-235784ec32c5]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:08 devstack sudo[83212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50
Apr 28 02:16:08 devstack sudo[83212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:08 devstack sudo[83208]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8e07c86-d463-4b4a-a19f-778fe0feb11f" returned: 0 in 0.652s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Lock "cinder-quobyte-d8e07c86-d463-4b4a-a19f-778fe0feb11f" released by "delete_volume" :: held 1.525s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Created reservations ['e6af9e3c-320e-4765-b370-d9b2af17bf91'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:16:08 devstack cinder-volume[81489]: WARNING cinder.quota [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-483238449 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-483238449, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:16:08 devstack cinder-volume[81489]: WARNING cinder.quota [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-483238449 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-483238449, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Created reservations ['6a911cc6-af6e-4b97-a929-e9bd53385c2f', '36a3f6f2-cadb-4656-a695-36343d4c46d5', 'a190bf33-7d11-437b-987b-eb39ace99c2e', 'c8e46de1-2819-4532-a109-3097a314e410'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:08 devstack sudo[83218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:16:08 devstack sudo[83218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:08 devstack sudo[83212]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50" returned: 0 in 0.732s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:08 devstack sudo[83225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50
Apr 28 02:16:08 devstack sudo[83225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:09 devstack sudo[83218]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.578s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:09 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:16:09 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ca68b680-edac-44ae-87a6-703df1c84f81 tempest-GroupsTest-16438842 None] Delete group completed successfully.
Apr 28 02:16:09 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-2851826c-6470-4423-be18-e62a19e1f5d3 tempest-GroupsTest-16438842 None] Created reservations ['19b3461f-9923-4adb-812d-a24c0acddb81'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:16:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2851826c-6470-4423-be18-e62a19e1f5d3 tempest-GroupsTest-16438842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2851826c-6470-4423-be18-e62a19e1f5d3 tempest-GroupsTest-16438842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2851826c-6470-4423-be18-e62a19e1f5d3 tempest-GroupsTest-16438842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2851826c-6470-4423-be18-e62a19e1f5d3 tempest-GroupsTest-16438842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2851826c-6470-4423-be18-e62a19e1f5d3 tempest-GroupsTest-16438842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2851826c-6470-4423-be18-e62a19e1f5d3 tempest-GroupsTest-16438842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:09 devstack sudo[83234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:16:09 devstack sudo[83234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:09 devstack sudo[83225]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ffa46bcc-92a1-489f-b953-2e47d6bbcf50" returned: 0 in 1.000s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:09 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Lock "cinder-quobyte-ffa46bcc-92a1-489f-b953-2e47d6bbcf50" released by "delete_volume" :: held 1.827s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:16:09 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Created reservations ['a0c9338f-6e80-4ca6-b150-b0b2ff056d13'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:16:10 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Created reservations ['e1f483df-9d4f-45b6-9c0a-eb0482a6471d', '770274f4-8330-4efb-b052-dcfaae307942', '206de9aa-af59-4cf4-b7a8-b5f0b0c5a0bb', '45815d29-a222-471d-bdf0-0a47dfff7b3e'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:16:10 devstack sudo[83234]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2851826c-6470-4423-be18-e62a19e1f5d3 tempest-GroupsTest-16438842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.762s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:10 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-2851826c-6470-4423-be18-e62a19e1f5d3 tempest-GroupsTest-16438842 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:16:10 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2851826c-6470-4423-be18-e62a19e1f5d3 tempest-GroupsTest-16438842 None] Delete group completed successfully.
Apr 28 02:16:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:10 devstack sudo[83260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:16:10 devstack sudo[83260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:11 devstack sudo[83260]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.306s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:11 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:16:11 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-741e31d0-d0f5-4b66-871d-ad1513f7059a tempest-GroupsV314Test-968680091 None] Delete group completed successfully.
Apr 28 02:16:11 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2d5e3227-16c6-41d6-aaba-e2fc81deec8d tempest-GroupsTest-16438842 None] Group tempest-GroupsTest-Group-948163097: creating
Apr 28 02:16:11 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2d5e3227-16c6-41d6-aaba-e2fc81deec8d tempest-GroupsTest-16438842 None] Group tempest-GroupsTest-Group-948163097: created successfully
Apr 28 02:16:11 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2d5e3227-16c6-41d6-aaba-e2fc81deec8d tempest-GroupsTest-16438842 None] Create group completed successfully.
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Flow 'volume_create_manager' (5974c3d6-fdf5-41c2-be3d-395920d953f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e718bad-b64f-4ad4-bae9-b320f8f0d070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e718bad-b64f-4ad4-bae9-b320f8f0d070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-820143167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c8a76ed4-bd43-4742-b20f-72f1d3337257,host='devstack@QuobyteHD#QuobyteHD',id=0996e736-49d7-46fe-bbde-48f39f2f4b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477963181cc84567b0a91184202c42aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:13Z,use_quota=True,user_id='fb617e2e7daf4612ac3cb4b596e012a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7077150-5e97-4f5b-9675-e0dfdf1e5ad3),volume_type_id=b7077150-5e97-4f5b-9675-e0dfdf1e5ad3)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c287572a-d458-4628-97c8-67a81c2916ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c287572a-d458-4628-97c8-67a81c2916ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a76704c-ca2d-4c12-a29e-f8a5a99a9e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a76704c-ca2d-4c12-a29e-f8a5a99a9e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0996e736-49d7-46fe-bbde-48f39f2f4b1e', 'volume_name': 'volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ae17c9-b9a6-4e80-bf2c-87d1c9e1f2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ae17c9-b9a6-4e80-bf2c-87d1c9e1f2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3f8587-26ac-4838-9010-1c91d9df58d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:13 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Volume 0996e736-49d7-46fe-bbde-48f39f2f4b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e', 'volume_size': 1}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c8a76ed4-bd43-4742-b20f-72f1d3337257,created_at=2026-04-28T00:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-820143167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c8a76ed4-bd43-4742-b20f-72f1d3337257,host='devstack@QuobyteHD#QuobyteHD',id=0996e736-49d7-46fe-bbde-48f39f2f4b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477963181cc84567b0a91184202c42aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:13Z,use_quota=True,user_id='fb617e2e7daf4612ac3cb4b596e012a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7077150-5e97-4f5b-9675-e0dfdf1e5ad3),volume_type_id=b7077150-5e97-4f5b-9675-e0dfdf1e5ad3)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Creating volume 0996e736-49d7-46fe-bbde-48f39f2f4b1e {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:16:13 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:16:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:13 devstack sudo[83277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e 1073741824
Apr 28 02:16:13 devstack sudo[83277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:14 devstack sudo[83277]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e 1073741824" returned: 0 in 1.294s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:15 devstack sudo[83283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e
Apr 28 02:16:15 devstack sudo[83283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:15 devstack sudo[83283]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e" returned: 0 in 0.945s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] <== create_volume: return (2311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:16:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.315s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3f8587-26ac-4838-9010-1c91d9df58d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a022a9-33be-4e32-8f0d-41012393ab28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:15 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Volume volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e (0996e736-49d7-46fe-bbde-48f39f2f4b1e): created successfully
Apr 28 02:16:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a022a9-33be-4e32-8f0d-41012393ab28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Flow 'volume_create_manager' (5974c3d6-fdf5-41c2-be3d-395920d953f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:16 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-5c1c5fc5-7642-4344-a089-288a15558432 tempest-GroupsTest-16438842 None] Created volume successfully.
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Flow 'volume_create_manager' (8653bebb-1f70-4f18-bdc8-c829cf46d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06d56e8-7c9c-4610-8dd9-0fe8e84b18c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06d56e8-7c9c-4610-8dd9-0fe8e84b18c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1248033960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c8a76ed4-bd43-4742-b20f-72f1d3337257,host='devstack@QuobyteHD#QuobyteHD',id=cfa7956f-2797-4d84-8552-9ca553a5ca55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477963181cc84567b0a91184202c42aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:17Z,use_quota=True,user_id='fb617e2e7daf4612ac3cb4b596e012a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7077150-5e97-4f5b-9675-e0dfdf1e5ad3),volume_type_id=b7077150-5e97-4f5b-9675-e0dfdf1e5ad3)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe91cf34-3bae-4664-960d-549853d2cddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe91cf34-3bae-4664-960d-549853d2cddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f240e2-d7ca-4a9f-ab5f-b2c886ba75e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f240e2-d7ca-4a9f-ab5f-b2c886ba75e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa7956f-2797-4d84-8552-9ca553a5ca55', 'volume_name': 'volume-cfa7956f-2797-4d84-8552-9ca553a5ca55', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ef539d-16d0-429a-a9bb-225580d3dea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ef539d-16d0-429a-a9bb-225580d3dea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76729bcd-1119-4067-8d74-0133f4e9d803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:17 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Volume cfa7956f-2797-4d84-8552-9ca553a5ca55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa7956f-2797-4d84-8552-9ca553a5ca55', 'volume_size': 1}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c8a76ed4-bd43-4742-b20f-72f1d3337257,created_at=2026-04-28T00:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1248033960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c8a76ed4-bd43-4742-b20f-72f1d3337257,host='devstack@QuobyteHD#QuobyteHD',id=cfa7956f-2797-4d84-8552-9ca553a5ca55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='477963181cc84567b0a91184202c42aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:17Z,use_quota=True,user_id='fb617e2e7daf4612ac3cb4b596e012a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7077150-5e97-4f5b-9675-e0dfdf1e5ad3),volume_type_id=b7077150-5e97-4f5b-9675-e0dfdf1e5ad3)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Creating volume cfa7956f-2797-4d84-8552-9ca553a5ca55 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:16:17 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:16:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cfa7956f-2797-4d84-8552-9ca553a5ca55 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:17 devstack sudo[83320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cfa7956f-2797-4d84-8552-9ca553a5ca55 1073741824
Apr 28 02:16:17 devstack sudo[83320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Flow 'volume_create_manager' (1784f2cd-2682-4d7e-8909-297cc739567c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d39a49-9042-44df-9b05-04417a698fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d39a49-9042-44df-9b05-04417a698fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-673390988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad82e273-3e94-4951-8246-bf73cdc0b868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c45a3fba7d240b7adf1e866bb9f89cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:18Z,use_quota=True,user_id='474b427ce1c040f1b71488e50357e140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c943cc2e-6b15-453e-addd-839d475e10e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c943cc2e-6b15-453e-addd-839d475e10e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc38fa7-5d89-4bae-b219-f217fb3fd71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc38fa7-5d89-4bae-b219-f217fb3fd71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad82e273-3e94-4951-8246-bf73cdc0b868', 'volume_name': 'volume-ad82e273-3e94-4951-8246-bf73cdc0b868', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb356806-3af1-43cf-8c18-c18f7c125b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb356806-3af1-43cf-8c18-c18f7c125b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c601490-f7bd-462b-9429-ecb73addb1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:18 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Volume ad82e273-3e94-4951-8246-bf73cdc0b868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad82e273-3e94-4951-8246-bf73cdc0b868', 'volume_size': 1}
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:18 devstack sudo[83320]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cfa7956f-2797-4d84-8552-9ca553a5ca55 1073741824" returned: 0 in 0.959s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cfa7956f-2797-4d84-8552-9ca553a5ca55 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:18 devstack sudo[83340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cfa7956f-2797-4d84-8552-9ca553a5ca55
Apr 28 02:16:18 devstack sudo[83340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:19 devstack sudo[83340]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cfa7956f-2797-4d84-8552-9ca553a5ca55" returned: 0 in 0.605s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.012s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-673390988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad82e273-3e94-4951-8246-bf73cdc0b868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c45a3fba7d240b7adf1e866bb9f89cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:18Z,use_quota=True,user_id='474b427ce1c040f1b71488e50357e140',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Creating volume ad82e273-3e94-4951-8246-bf73cdc0b868 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:16:19 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ad82e273-3e94-4951-8246-bf73cdc0b868 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:19 devstack sudo[83363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ad82e273-3e94-4951-8246-bf73cdc0b868 1073741824
Apr 28 02:16:19 devstack sudo[83363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76729bcd-1119-4067-8d74-0133f4e9d803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa7956f-2797-4d84-8552-9ca553a5ca55', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99436c3-aa96-4635-8e9e-869464fcc7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:19 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Volume volume-cfa7956f-2797-4d84-8552-9ca553a5ca55 (cfa7956f-2797-4d84-8552-9ca553a5ca55): created successfully
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99436c3-aa96-4635-8e9e-869464fcc7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Flow 'volume_create_manager' (8653bebb-1f70-4f18-bdc8-c829cf46d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:19 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3fe27f37-212f-41e9-be32-bd51bb9fa5c2 tempest-GroupsTest-16438842 None] Created volume successfully.
Apr 28 02:16:20 devstack sudo[83363]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ad82e273-3e94-4951-8246-bf73cdc0b868 1073741824" returned: 0 in 0.936s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ad82e273-3e94-4951-8246-bf73cdc0b868 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:20 devstack sudo[83383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ad82e273-3e94-4951-8246-bf73cdc0b868
Apr 28 02:16:20 devstack sudo[83383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:20 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-c9aa45ed-483d-4e7e-b0fa-dd4997cfa9e2 tempest-GroupsTest-16438842 None] Update group completed successfully.
Apr 28 02:16:20 devstack sudo[83383]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ad82e273-3e94-4951-8246-bf73cdc0b868" returned: 0 in 0.664s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:16:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c601490-f7bd-462b-9429-ecb73addb1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad82e273-3e94-4951-8246-bf73cdc0b868', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7e3fa8-4a32-48dd-93f9-a3d2f685de94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:20 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Volume volume-ad82e273-3e94-4951-8246-bf73cdc0b868 (ad82e273-3e94-4951-8246-bf73cdc0b868): created successfully
Apr 28 02:16:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c7e3fa8-4a32-48dd-93f9-a3d2f685de94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Flow 'volume_create_manager' (1784f2cd-2682-4d7e-8909-297cc739567c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:20 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-fd7ab854-30e2-4eb2-9bc5-644571473ee4 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Created volume successfully.
Apr 28 02:16:21 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-60a016b3-daa3-4f40-b2a3-5a3257f2de55 tempest-GroupsTest-16438842 None] Update group completed successfully.
Apr 28 02:16:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Acquiring lock "cinder-ad82e273-3e94-4951-8246-bf73cdc0b868-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:16:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Lock "cinder-ad82e273-3e94-4951-8246-bf73cdc0b868-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:16:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Acquiring lock "cinder-quobyte-ad82e273-3e94-4951-8246-bf73cdc0b868" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:16:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Lock "cinder-quobyte-ad82e273-3e94-4951-8246-bf73cdc0b868" acquired by "delete_volume" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:16:22 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdd38f5-e8e6-42b2-a5b4-e04ff69bae8a]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ad82e273-3e94-4951-8246-bf73cdc0b868 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:22 devstack sudo[83402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ad82e273-3e94-4951-8246-bf73cdc0b868
Apr 28 02:16:22 devstack sudo[83402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Acquiring lock "cinder-quobyte-0996e736-49d7-46fe-bbde-48f39f2f4b1e" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Lock "cinder-quobyte-0996e736-49d7-46fe-bbde-48f39f2f4b1e" acquired by "delete_volume" :: waited 0.028s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b44e7e-a748-473e-9ba0-d1c0f9a35022]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:23 devstack sudo[83406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e
Apr 28 02:16:23 devstack sudo[83406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:23 devstack sudo[83402]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ad82e273-3e94-4951-8246-bf73cdc0b868" returned: 0 in 0.816s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ad82e273-3e94-4951-8246-bf73cdc0b868 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:23 devstack sudo[83411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ad82e273-3e94-4951-8246-bf73cdc0b868
Apr 28 02:16:23 devstack sudo[83411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:23 devstack sudo[83406]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e" returned: 0 in 0.583s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:23 devstack sudo[83418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e
Apr 28 02:16:23 devstack sudo[83418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:23 devstack sudo[83411]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ad82e273-3e94-4951-8246-bf73cdc0b868" returned: 0 in 0.445s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Lock "cinder-quobyte-ad82e273-3e94-4951-8246-bf73cdc0b868" released by "delete_volume" :: held 1.325s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Created reservations ['b1fac859-37fe-4342-a314-27ef8915185a', 'ad6ceb77-215c-493a-b8ce-f7b0e849a276', 'dd622361-992a-4da7-9784-20b262da2e4e', 'fa1bb304-a22e-446d-8817-76717728ec41'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:23 devstack sudo[83420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:16:23 devstack sudo[83420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:24 devstack sudo[83418]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0996e736-49d7-46fe-bbde-48f39f2f4b1e" returned: 0 in 0.458s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Lock "cinder-quobyte-0996e736-49d7-46fe-bbde-48f39f2f4b1e" released by "delete_volume" :: held 1.115s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:16:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Acquiring lock "cinder-quobyte-cfa7956f-2797-4d84-8552-9ca553a5ca55" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:16:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Lock "cinder-quobyte-cfa7956f-2797-4d84-8552-9ca553a5ca55" acquired by "delete_volume" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:16:24 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d752356-5926-46cd-a158-3b8b5cb1a5f1]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cfa7956f-2797-4d84-8552-9ca553a5ca55 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:24 devstack sudo[83424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cfa7956f-2797-4d84-8552-9ca553a5ca55
Apr 28 02:16:24 devstack sudo[83424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:24 devstack sudo[83420]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.599s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:24 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:16:24 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Deleted volume successfully.
Apr 28 02:16:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9c74f868-3524-444b-ad81-14404dabe8d3 tempest-VolumeQuotasNegativeTestJSON-1267106417 None] Lock "cinder-ad82e273-3e94-4951-8246-bf73cdc0b868-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:16:24 devstack sudo[83424]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cfa7956f-2797-4d84-8552-9ca553a5ca55" returned: 0 in 0.564s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cfa7956f-2797-4d84-8552-9ca553a5ca55 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:24 devstack sudo[83430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cfa7956f-2797-4d84-8552-9ca553a5ca55
Apr 28 02:16:24 devstack sudo[83430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:25 devstack sudo[83430]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cfa7956f-2797-4d84-8552-9ca553a5ca55" returned: 0 in 0.489s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Lock "cinder-quobyte-cfa7956f-2797-4d84-8552-9ca553a5ca55" released by "delete_volume" :: held 1.131s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:16:25 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Created reservations ['cf82d988-d256-435d-b702-806fd3484201'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:16:25 devstack cinder-volume[81489]: WARNING cinder.quota [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1863345395 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1863345395, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:16:25 devstack cinder-volume[81489]: WARNING cinder.quota [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1863345395 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1863345395, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:16:25 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Created reservations ['4305bd1f-822b-4c04-bf36-f7fe41636187', '6aa52cec-feef-40f4-83d5-47a0c320e74d', '9a245d43-c07a-4c17-ba55-9e873a1e4f32', '4837af5d-e117-4f92-b22b-8dcce19be242'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:16:25 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Created reservations ['daac94f7-64e4-4730-8ca6-fe60390d0eca', 'dc28a09f-5273-4ce5-91fe-2a789ede1986', '3e708ba5-9242-494c-8133-b43ba34d4f01', '66bd1d9e-5405-486b-b78d-789437511152'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:16:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:25 devstack sudo[83433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:16:25 devstack sudo[83433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:26 devstack sudo[83433]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.671s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:26 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:16:26 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6cee53a7-0394-4b5a-860d-8e1d18595483 tempest-GroupsTest-16438842 None] Delete group completed successfully.
Apr 28 02:16:35 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:UPDATE=86,cinder:SELECT=61,cinder:DELETE=2,cinder:INSERT=17 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:16:35 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:UPDATE=72,cinder:SELECT=72,cinder:INSERT=16,cinder:DELETE=3 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:16:36 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:16:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Flow 'volume_create_manager' (f784db29-00ca-4c6f-85e6-c02062d1276e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ad228f-427d-4481-acd9-a2d29c0b5fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ad228f-427d-4481-acd9-a2d29c0b5fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-547108848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd6874c-652b-4d11-b65f-3a811ae59d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4eb2350e1ba4931b0d8e881f0c8a952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:36Z,use_quota=True,user_id='e1bbdf1ae31e40fda0602341f7f9ea11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e32710-d499-49e1-906b-99e45e441a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e32710-d499-49e1-906b-99e45e441a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0800def-c788-4e67-985f-c11d92fee886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:36 devstack cinder-volume[81489]: DEBUG cinder.image.glance [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Creating Keystone auth plugin from conf {{(pid=81489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 28 02:16:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0800def-c788-4e67-985f-c11d92fee886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8bd6874c-652b-4d11-b65f-3a811ae59d97', 'volume_name': 'volume-8bd6874c-652b-4d11-b65f-3a811ae59d97', 'volume_size': 1, 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd359658886d548bfa4a779ff0e6805b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68696e90-4455-4dcc-8c91-372acb183045', 'created_at': datetime.datetime(2026, 4, 28, 0, 10, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 0, 10, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68696e90-4455-4dcc-8c91-372acb183045/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd3e936a620>}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749961db-4772-4da1-a246-bcdb6fe12d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749961db-4772-4da1-a246-bcdb6fe12d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0105141e-15e3-4635-a6f2-6b8532b7c72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:37 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Volume 8bd6874c-652b-4d11-b65f-3a811ae59d97: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8bd6874c-652b-4d11-b65f-3a811ae59d97', 'volume_size': 1, 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd359658886d548bfa4a779ff0e6805b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68696e90-4455-4dcc-8c91-372acb183045', 'created_at': datetime.datetime(2026, 4, 28, 0, 10, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 0, 10, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68696e90-4455-4dcc-8c91-372acb183045/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd3e936a620>}
Apr 28 02:16:37 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Trying to clone 8bd6874c-652b-4d11-b65f-3a811ae59d97 from image 68696e90-4455-4dcc-8c91-372acb183045 at location (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]). {{(pid=81489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 28 02:16:38 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81489) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 28 02:16:38 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Image download 20.69 MB at 20.69 MB/s
Apr 28 02:16:38 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c37ed67-bfc7-41ab-a449-07a8860a9e12]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:38 devstack sudo[83609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD
Apr 28 02:16:38 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:39 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD" returned: 0 in 1.327s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:39 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Temporary image 68696e90-4455-4dcc-8c91-372acb183045 is fetched for user e1bbdf1ae31e40fda0602341f7f9ea11. {{(pid=81489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 28 02:16:39 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a81968a-5382-47f5-95b1-b7a4da253d67]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:39 devstack sudo[83619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD
Apr 28 02:16:39 devstack sudo[83619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Flow 'volume_create_manager' (41d918f7-914c-45fa-b883-76a34ffccca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c6a6a9-7a6f-486e-a145-a6d4e56c9f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:41 devstack sudo[83619]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD" returned: 0 in 1.596s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-547108848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd6874c-652b-4d11-b65f-3a811ae59d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4eb2350e1ba4931b0d8e881f0c8a952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:36Z,use_quota=True,user_id='e1bbdf1ae31e40fda0602341f7f9ea11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Creating volume 8bd6874c-652b-4d11-b65f-3a811ae59d97 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:16:41 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c6a6a9-7a6f-486e-a145-a6d4e56c9f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-519034466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4450cc4-8337-4f38-96c7-85fa8c50f0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5403c8ad2a4442519d110f2e92970273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:41Z,use_quota=True,user_id='9e514070dc574d87b6d8f69bfb8733f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:41 devstack sudo[83625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 1073741824
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a608d84e-3c6d-4faa-988a-601d18eb05c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:41 devstack sudo[83625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a608d84e-3c6d-4faa-988a-601d18eb05c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3bde90-16ca-4fce-a3c2-f448c94ee32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3bde90-16ca-4fce-a3c2-f448c94ee32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4450cc4-8337-4f38-96c7-85fa8c50f0a2', 'volume_name': 'volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7944afc3-ad11-4f82-bd88-35b50c988890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7944afc3-ad11-4f82-bd88-35b50c988890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd65297-3ce6-4f49-a66c-3e6b658146dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:41 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Volume f4450cc4-8337-4f38-96c7-85fa8c50f0a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2', 'volume_size': 1}
Apr 28 02:16:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:42 devstack sudo[83625]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 1073741824" returned: 0 in 1.217s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:42 devstack sudo[83630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97
Apr 28 02:16:42 devstack sudo[83630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:42 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Flow 'volume_create_manager' (2f6b1493-d1cb-4257-a97c-60413a7916c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f9c940-e5a5-4192-96ad-d4203f6434b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f9c940-e5a5-4192-96ad-d4203f6434b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1364962904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa43a178-1a10-414f-aec4-83dc90e4967a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adec2c9e232544b297784a50690fe7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:43Z,use_quota=True,user_id='b6f3371c1fd4458b8ac2fe93d99a3ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae31a375-5dc4-4e1c-b3af-1dc011f84179),volume_type_id=ae31a375-5dc4-4e1c-b3af-1dc011f84179)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e4bea3-60fb-4c12-b9ac-01bf11ff74c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e4bea3-60fb-4c12-b9ac-01bf11ff74c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2881c91-5d8a-48e2-93ed-fedbc6c6058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2881c91-5d8a-48e2-93ed-fedbc6c6058f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa43a178-1a10-414f-aec4-83dc90e4967a', 'volume_name': 'volume-aa43a178-1a10-414f-aec4-83dc90e4967a', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f99affb-e750-49a8-b4a7-b867999e2a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f99affb-e750-49a8-b4a7-b867999e2a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44643e39-3785-482b-937f-7c481a529a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:43 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Volume aa43a178-1a10-414f-aec4-83dc90e4967a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa43a178-1a10-414f-aec4-83dc90e4967a', 'volume_size': 1}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:43 devstack sudo[83630]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97" returned: 0 in 0.969s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] <== create_volume: return (2274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.277s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.088s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-519034466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4450cc4-8337-4f38-96c7-85fa8c50f0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5403c8ad2a4442519d110f2e92970273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:41Z,use_quota=True,user_id='9e514070dc574d87b6d8f69bfb8733f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Creating volume f4450cc4-8337-4f38-96c7-85fa8c50f0a2 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:16:43 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:43 devstack sudo[83634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2 1073741824
Apr 28 02:16:43 devstack sudo[83634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG cinder.volume.volume_utils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Attempting download of 68696e90-4455-4dcc-8c91-372acb183045 ((None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}])) to volume 8bd6874c-652b-4d11-b65f-3a811ae59d97. {{(pid=81489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac38cb13-515b-45f6-a79c-beaa2f40a8dd]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_5_32cpo6 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:43 devstack sudo[83647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_5_32cpo6
Apr 28 02:16:43 devstack sudo[83647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:44 devstack sudo[83647]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_5_32cpo6" returned: 0 in 1.051s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_5_32cpo6 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:44 devstack sudo[83678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_5_32cpo6
Apr 28 02:16:44 devstack sudo[83678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:45 devstack sudo[83634]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2 1073741824" returned: 0 in 1.418s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:45 devstack sudo[83680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2
Apr 28 02:16:45 devstack sudo[83680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:45 devstack sudo[83678]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_5_32cpo6" returned: 1 in 1.039s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_5_32cpo6' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5d9769-8b40-4edd-baa6-374915bb0de1]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:45 devstack sudo[83680]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:45 devstack sudo[83685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2" returned: 0 in 0.832s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] <== create_volume: return (2323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.328s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:45 devstack sudo[83685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.719s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1364962904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa43a178-1a10-414f-aec4-83dc90e4967a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adec2c9e232544b297784a50690fe7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:43Z,use_quota=True,user_id='b6f3371c1fd4458b8ac2fe93d99a3ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae31a375-5dc4-4e1c-b3af-1dc011f84179),volume_type_id=ae31a375-5dc4-4e1c-b3af-1dc011f84179)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Creating volume aa43a178-1a10-414f-aec4-83dc90e4967a {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:16:45 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-aa43a178-1a10-414f-aec4-83dc90e4967a 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:45 devstack sudo[83687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-aa43a178-1a10-414f-aec4-83dc90e4967a 1073741824
Apr 28 02:16:45 devstack sudo[83687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd65297-3ce6-4f49-a66c-3e6b658146dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:46 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f1b9f2-f0ce-416d-bb4c-831c3b94ee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:46 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Volume volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2 (f4450cc4-8337-4f38-96c7-85fa8c50f0a2): created successfully
Apr 28 02:16:46 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f1b9f2-f0ce-416d-bb4c-831c3b94ee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:46 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Flow 'volume_create_manager' (41d918f7-914c-45fa-b883-76a34ffccca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:46 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-c2117cbc-6665-4b6b-98a4-62e326107e75 tempest-DeleteServersTestJSON-1838761220 None] Created volume successfully.
Apr 28 02:16:46 devstack sudo[83687]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-aa43a178-1a10-414f-aec4-83dc90e4967a 1073741824" returned: 0 in 0.795s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-aa43a178-1a10-414f-aec4-83dc90e4967a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:46 devstack sudo[83696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-aa43a178-1a10-414f-aec4-83dc90e4967a
Apr 28 02:16:46 devstack sudo[83696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:46 devstack sudo[83685]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD" returned: 0 in 1.078s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:46 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] 68696e90-4455-4dcc-8c91-372acb183045 was qcow2, converting to raw {{(pid=81489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 28 02:16:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:46 devstack sudo[83702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97
Apr 28 02:16:46 devstack sudo[83702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:48 devstack sudo[83696]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-aa43a178-1a10-414f-aec4-83dc90e4967a" returned: 0 in 1.265s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:16:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44643e39-3785-482b-937f-7c481a529a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa43a178-1a10-414f-aec4-83dc90e4967a', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f90f3b-932d-4bac-8699-5fcb98b7dcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:48 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Volume volume-aa43a178-1a10-414f-aec4-83dc90e4967a (aa43a178-1a10-414f-aec4-83dc90e4967a): created successfully
Apr 28 02:16:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f90f3b-932d-4bac-8699-5fcb98b7dcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Flow 'volume_create_manager' (2f6b1493-d1cb-4257-a97c-60413a7916c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:48 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-84b2d720-ff73-4b76-a858-181fc136c3ba tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Created volume successfully.
Apr 28 02:16:49 devstack sudo[83702]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d9ed11ce-9af4-4a69-9d40-935e1df92544 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d9ed11ce-9af4-4a69-9d40-935e1df92544 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d9ed11ce-9af4-4a69-9d40-935e1df92544 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d9ed11ce-9af4-4a69-9d40-935e1df92544 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d9ed11ce-9af4-4a69-9d40-935e1df92544 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d9ed11ce-9af4-4a69-9d40-935e1df92544 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97" returned: 0 in 2.765s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:49 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_cqh41cxedevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:16:49 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Converted 112.00 MB image at 40.45 MB/s
Apr 28 02:16:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:49 devstack sudo[83753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:16:49 devstack sudo[83753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:49 devstack sudo[83755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 1G
Apr 28 02:16:49 devstack sudo[83755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:50 devstack sudo[83753]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d9ed11ce-9af4-4a69-9d40-935e1df92544 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.010s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:50 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-d9ed11ce-9af4-4a69-9d40-935e1df92544 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:16:50 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d9ed11ce-9af4-4a69-9d40-935e1df92544 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Retype volume completed successfully.
Apr 28 02:16:50 devstack sudo[83755]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 1G" returned: 0 in 1.075s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:50 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a6d152-d3c7-407d-a371-4c36c22f5c61]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:50 devstack sudo[83799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97
Apr 28 02:16:50 devstack sudo[83799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Acquiring lock "cinder-aa43a178-1a10-414f-aec4-83dc90e4967a-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:16:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Lock "cinder-aa43a178-1a10-414f-aec4-83dc90e4967a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:16:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Acquiring lock "cinder-quobyte-aa43a178-1a10-414f-aec4-83dc90e4967a" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:16:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-62386d39-752d-4d5f-80d1-65d9429878c5 req-cc04b196-310a-43da-ae10-b5e5ca0117ad tempest-DeleteServersTestJSON-1838761220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-62386d39-752d-4d5f-80d1-65d9429878c5 req-cc04b196-310a-43da-ae10-b5e5ca0117ad tempest-DeleteServersTestJSON-1838761220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:51 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47db643-bc46-4848-b0f0-62333311b304]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-62386d39-752d-4d5f-80d1-65d9429878c5 req-cc04b196-310a-43da-ae10-b5e5ca0117ad tempest-DeleteServersTestJSON-1838761220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Lock "cinder-quobyte-aa43a178-1a10-414f-aec4-83dc90e4967a" acquired by "delete_volume" :: waited 0.068s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:16:51 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[44251552-8f16-4b83-ba5c-ac119c812664]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-aa43a178-1a10-414f-aec4-83dc90e4967a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:51 devstack sudo[83810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-aa43a178-1a10-414f-aec4-83dc90e4967a
Apr 28 02:16:51 devstack sudo[83810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:51 devstack sudo[83809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2
Apr 28 02:16:51 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:51 devstack sudo[83799]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97" returned: 0 in 1.092s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:52 devstack sudo[83815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97
Apr 28 02:16:52 devstack sudo[83815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:52 devstack sudo[83810]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-aa43a178-1a10-414f-aec4-83dc90e4967a" returned: 0 in 0.975s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-aa43a178-1a10-414f-aec4-83dc90e4967a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:52 devstack sudo[83824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-aa43a178-1a10-414f-aec4-83dc90e4967a
Apr 28 02:16:52 devstack sudo[83824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:52 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-62386d39-752d-4d5f-80d1-65d9429878c5 req-cc04b196-310a-43da-ae10-b5e5ca0117ad tempest-DeleteServersTestJSON-1838761220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2" returned: 0 in 1.109s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-62386d39-752d-4d5f-80d1-65d9429878c5 req-cc04b196-310a-43da-ae10-b5e5ca0117ad tempest-DeleteServersTestJSON-1838761220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.154s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-62386d39-752d-4d5f-80d1-65d9429878c5 req-cc04b196-310a-43da-ae10-b5e5ca0117ad tempest-DeleteServersTestJSON-1838761220 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499', 'name': 'volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '986d2944-4068-4df6-81bc-afbc9a871a4e', 'enforce_multipath': True} {{(pid=81489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 28 02:16:52 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-62386d39-752d-4d5f-80d1-65d9429878c5 req-cc04b196-310a-43da-ae10-b5e5ca0117ad tempest-DeleteServersTestJSON-1838761220 None] attachment_update completed successfully.
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:52 devstack sudo[83847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:16:52 devstack sudo[83847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:52 devstack sudo[83815]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97" returned: 1 in 0.773s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG cinder.volume.volume_utils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Downloaded image 68696e90-4455-4dcc-8c91-372acb183045 ((None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}])) to volume 8bd6874c-652b-4d11-b65f-3a811ae59d97 successfully. {{(pid=81489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Temporary image 68696e90-4455-4dcc-8c91-372acb183045 for user e1bbdf1ae31e40fda0602341f7f9ea11 is deleted. {{(pid=81489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG cinder.volume.volume_utils [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Marking volume 8bd6874c-652b-4d11-b65f-3a811ae59d97 as bootable. {{(pid=81489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Copying metadata from image 68696e90-4455-4dcc-8c91-372acb183045 to 8bd6874c-652b-4d11-b65f-3a811ae59d97. {{(pid=81489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Creating volume glance metadata for volume 8bd6874c-652b-4d11-b65f-3a811ae59d97 backed by image 68696e90-4455-4dcc-8c91-372acb183045 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0105141e-15e3-4635-a6f2-6b8532b7c72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd6874c-652b-4d11-b65f-3a811ae59d97', 'volume_size': 1, 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd359658886d548bfa4a779ff0e6805b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68696e90-4455-4dcc-8c91-372acb183045', 'created_at': datetime.datetime(2026, 4, 28, 0, 10, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 0, 10, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68696e90-4455-4dcc-8c91-372acb183045/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd3e936a620>}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c6e7ca-0d02-4268-ba17-a104ce6a5218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:52 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Volume volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 (8bd6874c-652b-4d11-b65f-3a811ae59d97): created successfully
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c6e7ca-0d02-4268-ba17-a104ce6a5218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Flow 'volume_create_manager' (f784db29-00ca-4c6f-85e6-c02062d1276e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:52 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-389edacd-b7e5-4428-b4b0-0710f124640e tempest-VolumesImageMetadata-844791699 None] Created volume successfully.
Apr 28 02:16:53 devstack sudo[83824]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-aa43a178-1a10-414f-aec4-83dc90e4967a" returned: 0 in 0.762s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Lock "cinder-quobyte-aa43a178-1a10-414f-aec4-83dc90e4967a" released by "delete_volume" :: held 1.804s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:16:53 devstack cinder-volume[81489]: WARNING cinder.quota [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:16:53 devstack cinder-volume[81489]: WARNING cinder.quota [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Created reservations ['a72df75d-f1ef-4851-907c-bc4b18373678', '21688fb2-b917-40e7-a404-4ee55e4ad7b7', '07bb15c4-271c-4a43-ae76-6fdafdfed7fe', '9fa78324-afe8-49aa-9e14-88684dea0e8c'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:16:53 devstack sudo[83847]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.627s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:53 devstack sudo[83851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:16:53 devstack sudo[83851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:53 devstack sudo[83851]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.615s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:16:53 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Deleted volume successfully.
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Acquiring lock "cinder-8bd6874c-652b-4d11-b65f-3a811ae59d97-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f644ee0b-62b6-44cd-83c9-5b6db5fc98d5 tempest-VolumeRetypeWithoutMigrationTest-1774553923 None] Lock "cinder-aa43a178-1a10-414f-aec4-83dc90e4967a-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Lock "cinder-8bd6874c-652b-4d11-b65f-3a811ae59d97-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:16:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Acquiring lock "cinder-quobyte-8bd6874c-652b-4d11-b65f-3a811ae59d97" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:16:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Lock "cinder-quobyte-8bd6874c-652b-4d11-b65f-3a811ae59d97" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:16:54 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0c022f-b108-4b95-93a1-142ae6a27398]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:16:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:54 devstack sudo[83860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97
Apr 28 02:16:54 devstack sudo[83860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:54 devstack sudo[83860]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97" returned: 0 in 0.687s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:54 devstack sudo[83868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97
Apr 28 02:16:54 devstack sudo[83868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:55 devstack sudo[83868]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97" returned: 1 in 0.716s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:16:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:55 devstack sudo[83875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97
Apr 28 02:16:55 devstack sudo[83875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:56 devstack sudo[83875]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8bd6874c-652b-4d11-b65f-3a811ae59d97" returned: 0 in 0.575s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Lock "cinder-quobyte-8bd6874c-652b-4d11-b65f-3a811ae59d97" released by "delete_volume" :: held 2.054s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:16:56 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Created reservations ['80e4301b-eabc-44e8-be8c-7c8980f62f8b', 'ff583159-860c-452a-a04a-f7751703d8a0', 'd25134bc-424f-4471-a37a-bc35ce347fa7', '52ebae46-0507-4a17-ac86-d9f061e1b449'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:16:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:56 devstack sudo[83878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:16:56 devstack sudo[83878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:16:56 devstack sudo[83878]: pam_unix(sudo:session): session closed for user root
Apr 28 02:16:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.539s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:16:56 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:16:56 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Deleted volume successfully.
Apr 28 02:16:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-880eac8a-f5de-4f60-a509-c6fa8de0e302 tempest-VolumesImageMetadata-844791699 None] Lock "cinder-8bd6874c-652b-4d11-b65f-3a811ae59d97-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Flow 'volume_create_manager' (b8dfe962-7f4f-4d30-b11a-e34c26f50248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c7f87f-9baa-4395-be18-4f65360cd4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c7f87f-9baa-4395-be18-4f65360cd4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-739181204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a29662-333c-4f66-a235-292fe638f196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808c46f032ae47a3831ef73131de13df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:59Z,use_quota=True,user_id='312e71c37c69467b9a6e9bbd01ae9b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631e8cf1-fa31-4acd-84b1-13bdecefd9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631e8cf1-fa31-4acd-84b1-13bdecefd9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3379c485-a875-46e3-8a46-5c5607fdc3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3379c485-a875-46e3-8a46-5c5607fdc3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9a29662-333c-4f66-a235-292fe638f196', 'volume_name': 'volume-d9a29662-333c-4f66-a235-292fe638f196', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fa69ab-6929-43ed-944e-a67a08b1cf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fa69ab-6929-43ed-944e-a67a08b1cf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f19df00-88b1-4b05-8e9b-e87bc0c8802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:16:59 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Volume d9a29662-333c-4f66-a235-292fe638f196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9a29662-333c-4f66-a235-292fe638f196', 'volume_size': 1}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-739181204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9a29662-333c-4f66-a235-292fe638f196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808c46f032ae47a3831ef73131de13df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:16:59Z,use_quota=True,user_id='312e71c37c69467b9a6e9bbd01ae9b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Creating volume d9a29662-333c-4f66-a235-292fe638f196 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:16:59 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:16:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d9a29662-333c-4f66-a235-292fe638f196 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:16:59 devstack sudo[83916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d9a29662-333c-4f66-a235-292fe638f196 1073741824
Apr 28 02:16:59 devstack sudo[83916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:00 devstack sudo[83916]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d9a29662-333c-4f66-a235-292fe638f196 1073741824" returned: 0 in 0.883s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d9a29662-333c-4f66-a235-292fe638f196 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:00 devstack sudo[83922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d9a29662-333c-4f66-a235-292fe638f196
Apr 28 02:17:00 devstack sudo[83922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:01 devstack sudo[83922]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d9a29662-333c-4f66-a235-292fe638f196" returned: 0 in 0.732s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:17:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f19df00-88b1-4b05-8e9b-e87bc0c8802f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9a29662-333c-4f66-a235-292fe638f196', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b589592-8894-4488-8b2a-1b21f316f9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:01 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Volume volume-d9a29662-333c-4f66-a235-292fe638f196 (d9a29662-333c-4f66-a235-292fe638f196): created successfully
Apr 28 02:17:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b589592-8894-4488-8b2a-1b21f316f9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Flow 'volume_create_manager' (b8dfe962-7f4f-4d30-b11a-e34c26f50248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:01 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-0493873b-207e-4f5a-b935-1f6b5a7523e5 tempest-VolumesServicesTestJSON-1469046095 None] Created volume successfully.
Apr 28 02:17:01 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Flow 'volume_create_manager' (7e52fa65-8b4a-427d-b7ac-dd80ce27a1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4bd68b-7097-44b7-bc6c-7a46acac3e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4bd68b-7097-44b7-bc6c-7a46acac3e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-804227613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac411e0-2a46-4bf0-b71b-091ca3aa0e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00fc2be5084d90bfb5b2c912675730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:02Z,use_quota=True,user_id='f61fb92a5c664c1e84dc049e7aa06f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130bb2fe-2b61-4ca2-8390-64e15690b971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130bb2fe-2b61-4ca2-8390-64e15690b971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024c7bf9-a213-4a16-bb50-d24896c6d506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024c7bf9-a213-4a16-bb50-d24896c6d506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac411e0-2a46-4bf0-b71b-091ca3aa0e08', 'volume_name': 'volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2e312f-c7d5-4864-80a8-229e4b9e8167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2e312f-c7d5-4864-80a8-229e4b9e8167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a40e8c-4e20-4e4a-984c-1a0983e95a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:02 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Volume 0ac411e0-2a46-4bf0-b71b-091ca3aa0e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08', 'volume_size': 1}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-804227613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac411e0-2a46-4bf0-b71b-091ca3aa0e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00fc2be5084d90bfb5b2c912675730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:02Z,use_quota=True,user_id='f61fb92a5c664c1e84dc049e7aa06f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Creating volume 0ac411e0-2a46-4bf0-b71b-091ca3aa0e08 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:17:02 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:02 devstack sudo[83932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08 1073741824
Apr 28 02:17:02 devstack sudo[83932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Flow 'volume_create_manager' (bf5afa22-5009-4e5d-b074-56bfe8a81fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75720704-a934-4047-8552-892c40406fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75720704-a934-4047-8552-892c40406fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:02Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f516817-2d91-419a-a5b0-004304e47d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b10af974cb45e3adfd1829c4aac446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:02Z,use_quota=True,user_id='0ae0afab83f3411dbe41014e4cdd529d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86984ba4-a6e6-4a36-81e0-5809290fa08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86984ba4-a6e6-4a36-81e0-5809290fa08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc16eb65-b92f-428d-ad1c-10e005336d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.image.glance [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Creating Keystone auth plugin from conf {{(pid=81489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 28 02:17:02 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-05c05081-e614-4f16-a1ce-141015d8e4a6 req-226bb355-cf33-4bdb-9351-b10da087b6c8 tempest-DeleteServersTestJSON-1838761220 None] Terminate volume connection completed successfully.
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-05c05081-e614-4f16-a1ce-141015d8e4a6 req-226bb355-cf33-4bdb-9351-b10da087b6c8 tempest-DeleteServersTestJSON-1838761220 None] Deleting attachment 986d2944-4068-4df6-81bc-afbc9a871a4e. {{(pid=81489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Acquiring lock "cinder-d9a29662-333c-4f66-a235-292fe638f196-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Lock "cinder-d9a29662-333c-4f66-a235-292fe638f196-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Acquiring lock "cinder-quobyte-d9a29662-333c-4f66-a235-292fe638f196" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Lock "cinder-quobyte-d9a29662-333c-4f66-a235-292fe638f196" acquired by "delete_volume" :: waited 0.029s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a45c59-def7-49c1-ba28-b5cf67c7a371]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d9a29662-333c-4f66-a235-292fe638f196 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc16eb65-b92f-428d-ad1c-10e005336d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0f516817-2d91-419a-a5b0-004304e47d86', 'volume_name': 'volume-0f516817-2d91-419a-a5b0-004304e47d86', 'volume_size': 1, 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd359658886d548bfa4a779ff0e6805b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68696e90-4455-4dcc-8c91-372acb183045', 'created_at': datetime.datetime(2026, 4, 28, 0, 10, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 0, 10, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68696e90-4455-4dcc-8c91-372acb183045/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd3e8c5e830>}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99949dfb-4c25-4238-8315-2483aa92623d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99949dfb-4c25-4238-8315-2483aa92623d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752fff9b-bbcc-410e-bcf4-e9aedf91f1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:02 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Volume 0f516817-2d91-419a-a5b0-004304e47d86: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0f516817-2d91-419a-a5b0-004304e47d86', 'volume_size': 1, 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd359658886d548bfa4a779ff0e6805b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68696e90-4455-4dcc-8c91-372acb183045', 'created_at': datetime.datetime(2026, 4, 28, 0, 10, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 0, 10, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68696e90-4455-4dcc-8c91-372acb183045/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd3e8c5e830>}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Trying to clone 0f516817-2d91-419a-a5b0-004304e47d86 from image 68696e90-4455-4dcc-8c91-372acb183045 at location (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]). {{(pid=81489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 28 02:17:02 devstack sudo[83935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d9a29662-333c-4f66-a235-292fe638f196
Apr 28 02:17:02 devstack sudo[83935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81489) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 28 02:17:02 devstack cinder-volume[81489]: INFO cinder.image.image_utils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Image download 20.69 MB at 20.69 MB/s
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9a49b8-2e8d-46bf-ae6b-918b456d09e5]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:03 devstack sudo[83932]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:03 devstack sudo[83941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD
Apr 28 02:17:03 devstack sudo[83941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08 1073741824" returned: 0 in 0.974s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:03 devstack sudo[83943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08
Apr 28 02:17:03 devstack sudo[83943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:03 devstack sudo[83935]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d9a29662-333c-4f66-a235-292fe638f196" returned: 0 in 0.840s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d9a29662-333c-4f66-a235-292fe638f196 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:03 devstack sudo[83949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d9a29662-333c-4f66-a235-292fe638f196
Apr 28 02:17:03 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:03 devstack sudo[83941]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD" returned: 0 in 0.704s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Temporary image 68696e90-4455-4dcc-8c91-372acb183045 is fetched for user 0ae0afab83f3411dbe41014e4cdd529d. {{(pid=81489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 28 02:17:03 devstack sudo[83943]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08" returned: 0 in 0.588s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a40e8c-4e20-4e4a-984c-1a0983e95a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5122fb-3ffe-4931-b68a-aa8149be1609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:03 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Volume volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08 (0ac411e0-2a46-4bf0-b71b-091ca3aa0e08): created successfully
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5122fb-3ffe-4931-b68a-aa8149be1609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Flow 'volume_create_manager' (7e52fa65-8b4a-427d-b7ac-dd80ce27a1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:03 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-48316831-4299-4115-bb85-6cf9482c485e tempest-AbsoluteLimitsTests-187434852 None] Created volume successfully.
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[191c22cd-62e6-4112-9af1-f0a8bf3e921b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:03 devstack sudo[83955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD
Apr 28 02:17:03 devstack sudo[83955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:03 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d9a29662-333c-4f66-a235-292fe638f196" returned: 0 in 0.544s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Lock "cinder-quobyte-d9a29662-333c-4f66-a235-292fe638f196" released by "delete_volume" :: held 1.436s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:03 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Created reservations ['772c14c6-0b5b-498c-9aa0-c00621e95285', '2f90c617-dda8-4243-b556-d6a2e259e148', 'f92426e4-e5a7-4a22-92ed-af367dbccdf4', 'b755ab01-4603-4042-8e95-b97e44ae781c'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:04 devstack sudo[83958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:17:04 devstack sudo[83958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Acquiring lock "cinder-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Lock "cinder-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Acquiring lock "cinder-quobyte-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Lock "cinder-quobyte-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3467e892-c0d1-4dc9-9385-7809b7b98ca0]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:04 devstack sudo[83955]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD" returned: 0 in 0.627s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:02Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f516817-2d91-419a-a5b0-004304e47d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86b10af974cb45e3adfd1829c4aac446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:02Z,use_quota=True,user_id='0ae0afab83f3411dbe41014e4cdd529d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Creating volume 0f516817-2d91-419a-a5b0-004304e47d86 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:17:04 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:04 devstack sudo[83964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 1073741824
Apr 28 02:17:04 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:04 devstack sudo[83963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08
Apr 28 02:17:04 devstack sudo[83963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:04 devstack sudo[83958]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.626s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:17:04 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Deleted volume successfully.
Apr 28 02:17:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d029a062-dc95-456d-bc5e-3317d199e451 tempest-VolumesServicesTestJSON-1469046095 None] Lock "cinder-d9a29662-333c-4f66-a235-292fe638f196-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:05 devstack sudo[83963]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08" returned: 0 in 0.733s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:05 devstack sudo[83974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08
Apr 28 02:17:05 devstack sudo[83974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:05 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 1073741824" returned: 0 in 0.774s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:05 devstack sudo[83976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86
Apr 28 02:17:05 devstack sudo[83976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:05 devstack sudo[83974]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08" returned: 0 in 0.608s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Lock "cinder-quobyte-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08" released by "delete_volume" :: held 1.393s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Created reservations ['32989ad1-4639-4dce-91c6-b904bcf5005c', 'd17b4065-3269-42d6-8072-532b5427a0d5', '477beca8-06b0-4a2f-ad33-0d99e622ab0b', '8e03aad4-ca65-416f-8b99-14523b117798'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:17:05 devstack sudo[83976]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86" returned: 0 in 0.596s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG cinder.volume.volume_utils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Attempting download of 68696e90-4455-4dcc-8c91-372acb183045 ((None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}])) to volume 0f516817-2d91-419a-a5b0-004304e47d86. {{(pid=81489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 28 02:17:05 devstack sudo[83980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:17:05 devstack sudo[83980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c42504-f89c-4aac-9406-24080a01ea6d]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_vbwuawuw {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:06 devstack sudo[83982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_vbwuawuw
Apr 28 02:17:06 devstack sudo[83982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Acquiring lock "cinder-f4450cc4-8337-4f38-96c7-85fa8c50f0a2-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Lock "cinder-f4450cc4-8337-4f38-96c7-85fa8c50f0a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Acquiring lock "cinder-quobyte-f4450cc4-8337-4f38-96c7-85fa8c50f0a2" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Lock "cinder-quobyte-f4450cc4-8337-4f38-96c7-85fa8c50f0a2" acquired by "delete_volume" :: waited 0.027s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:06 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d117146d-025e-4734-ada2-ffa7e904e4e0]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:06 devstack sudo[83984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2
Apr 28 02:17:06 devstack sudo[83984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:06 devstack sudo[83980]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.676s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:06 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:17:06 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Deleted volume successfully.
Apr 28 02:17:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f821db5-8b2b-4df0-a4f8-1bbb85b47d83 tempest-AbsoluteLimitsTests-187434852 None] Lock "cinder-0ac411e0-2a46-4bf0-b71b-091ca3aa0e08-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:06 devstack sudo[83982]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_vbwuawuw" returned: 0 in 0.776s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_vbwuawuw {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:06 devstack sudo[83989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_vbwuawuw
Apr 28 02:17:06 devstack sudo[83989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:06 devstack sudo[83984]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2" returned: 0 in 0.767s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:07 devstack sudo[83995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2
Apr 28 02:17:07 devstack sudo[83995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:07 devstack sudo[83989]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_vbwuawuw" returned: 1 in 0.654s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_vbwuawuw' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:17:07 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5099ec3c-245f-45f9-ae3d-e7866ae5e59e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:07 devstack sudo[83999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD
Apr 28 02:17:07 devstack sudo[83999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:07 devstack sudo[83995]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f4450cc4-8337-4f38-96c7-85fa8c50f0a2" returned: 0 in 0.596s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:07 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Lock "cinder-quobyte-f4450cc4-8337-4f38-96c7-85fa8c50f0a2" released by "delete_volume" :: held 1.413s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:07 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Created reservations ['db435be4-cd42-4e05-b198-599e49c58cd9', 'ab6d4761-df2b-4baa-9229-dd9185ae9bd4', '39bbc29f-5af3-4569-a194-6ab411340e7f', '4b2ca6b3-4040-4652-ae0d-64ff58d2600f'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:17:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:07 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:07 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:07 devstack sudo[84002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:17:07 devstack sudo[84002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:08 devstack sudo[83999]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD" returned: 0 in 0.712s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:08 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] 68696e90-4455-4dcc-8c91-372acb183045 was qcow2, converting to raw {{(pid=81489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 28 02:17:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:08 devstack sudo[84007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86
Apr 28 02:17:08 devstack sudo[84007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:08 devstack sudo[84002]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.513s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:08 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:17:08 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Deleted volume successfully.
Apr 28 02:17:08 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9e6e1f1d-da5f-414d-af8e-75cb3707450b tempest-DeleteServersTestJSON-1838761220 None] Lock "cinder-f4450cc4-8337-4f38-96c7-85fa8c50f0a2-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:10 devstack sudo[84007]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86" returned: 0 in 1.945s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:10 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_n0en0lnzdevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:17:10 devstack cinder-volume[81489]: INFO cinder.image.image_utils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Converted 112.00 MB image at 57.53 MB/s
Apr 28 02:17:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:10 devstack sudo[84027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 1G
Apr 28 02:17:10 devstack sudo[84027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:10 devstack sudo[84027]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 1G" returned: 0 in 0.722s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:10 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fde87d-4f56-44c4-afad-ffbeabd3dadd]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:10 devstack sudo[84033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86
Apr 28 02:17:10 devstack sudo[84033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:11 devstack sudo[84033]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86" returned: 0 in 0.805s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:11 devstack sudo[84037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86
Apr 28 02:17:11 devstack sudo[84037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:12 devstack sudo[84037]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86" returned: 1 in 0.816s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:17:12 devstack cinder-volume[81489]: DEBUG cinder.volume.volume_utils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Downloaded image 68696e90-4455-4dcc-8c91-372acb183045 ((None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}])) to volume 0f516817-2d91-419a-a5b0-004304e47d86 successfully. {{(pid=81489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 28 02:17:12 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Temporary image 68696e90-4455-4dcc-8c91-372acb183045 for user 0ae0afab83f3411dbe41014e4cdd529d is deleted. {{(pid=81489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 28 02:17:12 devstack cinder-volume[81489]: DEBUG cinder.volume.volume_utils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Marking volume 0f516817-2d91-419a-a5b0-004304e47d86 as bootable. {{(pid=81489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 28 02:17:12 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Copying metadata from image 68696e90-4455-4dcc-8c91-372acb183045 to 0f516817-2d91-419a-a5b0-004304e47d86. {{(pid=81489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 28 02:17:12 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Creating volume glance metadata for volume 0f516817-2d91-419a-a5b0-004304e47d86 backed by image 68696e90-4455-4dcc-8c91-372acb183045 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 28 02:17:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752fff9b-bbcc-410e-bcf4-e9aedf91f1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f516817-2d91-419a-a5b0-004304e47d86', 'volume_size': 1, 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd359658886d548bfa4a779ff0e6805b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68696e90-4455-4dcc-8c91-372acb183045', 'created_at': datetime.datetime(2026, 4, 28, 0, 10, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 0, 10, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68696e90-4455-4dcc-8c91-372acb183045/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd3e8c5e830>}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906d8337-091e-4c06-8579-8e03b3e01a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:12 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Volume volume-0f516817-2d91-419a-a5b0-004304e47d86 (0f516817-2d91-419a-a5b0-004304e47d86): created successfully
Apr 28 02:17:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906d8337-091e-4c06-8579-8e03b3e01a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Flow 'volume_create_manager' (bf5afa22-5009-4e5d-b074-56bfe8a81fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:12 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-a4ab9914-df45-4985-8950-fd9580cfdc1e tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Created volume successfully.
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Flow 'volume_create_manager' (778e5853-2321-4078-a15f-27e8d92035f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8222d542-22be-408f-8143-fbd093f810b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8222d542-22be-408f-8143-fbd093f810b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-961068860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322cccaf5f8e4cf2b1dc104f3c908739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:13Z,use_quota=True,user_id='7a36b8df4d094470aff9ac79be83aede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800e4385-d87e-489a-ae76-a098f7f9218d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800e4385-d87e-489a-ae76-a098f7f9218d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773fd3f6-86d6-4709-bc9b-c641418ae1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773fd3f6-86d6-4709-bc9b-c641418ae1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4', 'volume_name': 'volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82149d2-b28e-4b75-8432-cdc4f9afcf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82149d2-b28e-4b75-8432-cdc4f9afcf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd6ba9b-a403-45ce-850e-7b2b5b88d824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:13 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Volume a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4', 'volume_size': 1}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-961068860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322cccaf5f8e4cf2b1dc104f3c908739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:13Z,use_quota=True,user_id='7a36b8df4d094470aff9ac79be83aede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Creating volume a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:17:13 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:17:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:13 devstack sudo[84043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4 1073741824
Apr 28 02:17:13 devstack sudo[84043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:14 devstack sudo[84043]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4 1073741824" returned: 0 in 0.826s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:14 devstack sudo[84049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4
Apr 28 02:17:14 devstack sudo[84049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-17c635b7-cd15-49d5-8b68-cecea299dd67 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:15 devstack sudo[84049]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4" returned: 0 in 0.571s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:17:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-17c635b7-cd15-49d5-8b68-cecea299dd67 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.068s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd6ba9b-a403-45ce-850e-7b2b5b88d824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db697569-0c04-44b7-b0b3-e604071ba4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:15 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d770fbb-77b7-4801-b0cd-791d76197f2f]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-17c635b7-cd15-49d5-8b68-cecea299dd67 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:15 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Volume volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4 (a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4): created successfully
Apr 28 02:17:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db697569-0c04-44b7-b0b3-e604071ba4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Flow 'volume_create_manager' (778e5853-2321-4078-a15f-27e8d92035f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:15 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-e866e743-49d7-413f-b1dd-44df7563bdd8 tempest-VolumesTransfersTest-80810779 None] Created volume successfully.
Apr 28 02:17:15 devstack sudo[84060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86
Apr 28 02:17:15 devstack sudo[84060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:15 devstack sudo[84060]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-17c635b7-cd15-49d5-8b68-cecea299dd67 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86" returned: 0 in 0.826s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-17c635b7-cd15-49d5-8b68-cecea299dd67 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:16 devstack sudo[84064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86
Apr 28 02:17:16 devstack sudo[84064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:16 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6f250260-1717-4707-9bea-bfe96400f123 tempest-VolumesTransfersTest-616335577 None] Transfer volume completed successfully.
Apr 28 02:17:16 devstack sudo[84064]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-17c635b7-cd15-49d5-8b68-cecea299dd67 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86" returned: 1 in 0.734s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-17c635b7-cd15-49d5-8b68-cecea299dd67 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:17:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-17c635b7-cd15-49d5-8b68-cecea299dd67 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.612s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-17c635b7-cd15-49d5-8b68-cecea299dd67 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499', 'name': 'volume-0f516817-2d91-419a-a5b0-004304e47d86', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ecca524d-029c-4904-86dd-85ccb633e2d9', 'enforce_multipath': True} {{(pid=81489) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 28 02:17:16 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-d567845d-c1f3-40ca-9149-b5d20b964ef3 req-17c635b7-cd15-49d5-8b68-cecea299dd67 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] attachment_update completed successfully.
Apr 28 02:17:17 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Acquiring lock "cinder-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:17 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Lock "cinder-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:17 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Acquiring lock "cinder-quobyte-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:17 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Lock "cinder-quobyte-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4" acquired by "delete_volume" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:17 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[49059d4d-77b2-4176-8eb5-afbd8b22878a]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:17 devstack sudo[84070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4
Apr 28 02:17:17 devstack sudo[84070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:18 devstack sudo[84070]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4" returned: 0 in 0.641s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:18 devstack sudo[84075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4
Apr 28 02:17:18 devstack sudo[84075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:18 devstack sudo[84075]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4" returned: 0 in 0.527s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Lock "cinder-quobyte-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4" released by "delete_volume" :: held 1.223s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:19 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Created reservations ['97c30c30-3378-4660-a1c2-868a14835d3a', '2a4a9c41-8aa6-4350-94f6-0bbef8f39053', '0fb2da73-ffee-4806-b740-f93e977eaa79', '2c05484b-72a0-4319-9b5e-9bc1da6e8c67'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:17:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:19 devstack sudo[84078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:17:19 devstack sudo[84078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:19 devstack sudo[84078]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.560s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:19 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:17:19 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Deleted volume successfully.
Apr 28 02:17:19 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-78aaa3a2-85e6-4638-8ad2-5e3fad70de42 tempest-VolumesTransfersTest-773891372 None] Lock "cinder-a1c68843-e7d6-4951-8b10-4cb9ff6fc1f4-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Flow 'volume_create_manager' (83018a11-2d83-4553-a36d-99cbb976f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72eb614b-dd24-420e-91fe-006f1e9b41db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72eb614b-dd24-420e-91fe-006f1e9b41db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1834805393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad82dda-f762-43fe-83e7-892bf13ed30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322cccaf5f8e4cf2b1dc104f3c908739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:20Z,use_quota=True,user_id='7a36b8df4d094470aff9ac79be83aede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec97a43-4dd6-4eea-8ef7-38c6397bd642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec97a43-4dd6-4eea-8ef7-38c6397bd642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2938829e-f213-4671-8f29-3fe81a799ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2938829e-f213-4671-8f29-3fe81a799ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ad82dda-f762-43fe-83e7-892bf13ed30e', 'volume_name': 'volume-5ad82dda-f762-43fe-83e7-892bf13ed30e', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e296be7-5302-4914-a0e7-3ecf6c21258f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e296be7-5302-4914-a0e7-3ecf6c21258f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01fb6ff-06fa-486b-8215-8798f905b9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:20 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Volume 5ad82dda-f762-43fe-83e7-892bf13ed30e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ad82dda-f762-43fe-83e7-892bf13ed30e', 'volume_size': 1}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1834805393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ad82dda-f762-43fe-83e7-892bf13ed30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322cccaf5f8e4cf2b1dc104f3c908739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:20Z,use_quota=True,user_id='7a36b8df4d094470aff9ac79be83aede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Creating volume 5ad82dda-f762-43fe-83e7-892bf13ed30e {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:17:20 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:17:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ad82dda-f762-43fe-83e7-892bf13ed30e 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:20 devstack sudo[84085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ad82dda-f762-43fe-83e7-892bf13ed30e 1073741824
Apr 28 02:17:20 devstack sudo[84085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:21 devstack sudo[84085]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ad82dda-f762-43fe-83e7-892bf13ed30e 1073741824" returned: 0 in 1.125s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ad82dda-f762-43fe-83e7-892bf13ed30e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:21 devstack sudo[84099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ad82dda-f762-43fe-83e7-892bf13ed30e
Apr 28 02:17:21 devstack sudo[84099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:22 devstack sudo[84099]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ad82dda-f762-43fe-83e7-892bf13ed30e" returned: 0 in 0.695s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:17:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01fb6ff-06fa-486b-8215-8798f905b9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ad82dda-f762-43fe-83e7-892bf13ed30e', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6fdeab-7607-4f8e-96ba-a691badf8e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:22 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Volume volume-5ad82dda-f762-43fe-83e7-892bf13ed30e (5ad82dda-f762-43fe-83e7-892bf13ed30e): created successfully
Apr 28 02:17:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6fdeab-7607-4f8e-96ba-a691badf8e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Flow 'volume_create_manager' (83018a11-2d83-4553-a36d-99cbb976f586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:22 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3251c37c-94d5-4d94-9d53-3406076837f5 tempest-VolumesTransfersTest-80810779 None] Created volume successfully.
Apr 28 02:17:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Acquiring lock "cinder-5ad82dda-f762-43fe-83e7-892bf13ed30e-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Lock "cinder-5ad82dda-f762-43fe-83e7-892bf13ed30e-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Acquiring lock "cinder-quobyte-5ad82dda-f762-43fe-83e7-892bf13ed30e" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Lock "cinder-quobyte-5ad82dda-f762-43fe-83e7-892bf13ed30e" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:23 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a2b9a2-67aa-4206-a3bc-117fa3453ce8]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ad82dda-f762-43fe-83e7-892bf13ed30e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:23 devstack sudo[84140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ad82dda-f762-43fe-83e7-892bf13ed30e
Apr 28 02:17:23 devstack sudo[84140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:25 devstack sudo[84140]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ad82dda-f762-43fe-83e7-892bf13ed30e" returned: 0 in 1.531s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ad82dda-f762-43fe-83e7-892bf13ed30e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:25 devstack sudo[84151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ad82dda-f762-43fe-83e7-892bf13ed30e
Apr 28 02:17:25 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:26 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ad82dda-f762-43fe-83e7-892bf13ed30e" returned: 0 in 1.427s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:26 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Lock "cinder-quobyte-5ad82dda-f762-43fe-83e7-892bf13ed30e" released by "delete_volume" :: held 3.030s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:26 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Created reservations ['fbe0fd7b-8055-4cdb-8e6f-c911306c46b4', '5a3e3afd-4746-4569-a622-c15d2f2fafe2', 'b2a8f520-13c0-41de-9e83-5d084e2ff815', '41f99fda-eb4a-4e3e-845a-55d86ac89e03'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:17:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:26 devstack sudo[84166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:17:26 devstack sudo[84166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:28 devstack sudo[84166]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.626s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:28 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:17:28 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Deleted volume successfully.
Apr 28 02:17:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7b04aebc-799f-4e17-bc07-777d416e1a9a tempest-VolumesTransfersTest-773891372 None] Lock "cinder-5ad82dda-f762-43fe-83e7-892bf13ed30e-delete_volume" released by "delete_volume" :: held 5.194s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Flow 'volume_create_manager' (1fa20921-d317-4932-b8bc-608add5c34fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a764b99b-2980-4890-883d-8c25b6e3018f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a764b99b-2980-4890-883d-8c25b6e3018f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1039290095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69fffa6-6610-46bd-842d-4c965720148c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='042255896911426a95420543d4387c55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:34Z,use_quota=True,user_id='8b16a577b8e74bebb622e29e474ddeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87703776-6802-4e01-b65d-d9c96d9a70a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87703776-6802-4e01-b65d-d9c96d9a70a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0368f1-a076-4c00-8410-fc5ce2569929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0368f1-a076-4c00-8410-fc5ce2569929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b69fffa6-6610-46bd-842d-4c965720148c', 'volume_name': 'volume-b69fffa6-6610-46bd-842d-4c965720148c', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c089ed10-f748-420a-af7f-7a05f4a82db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c089ed10-f748-420a-af7f-7a05f4a82db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba5a0bd-2320-49a5-ba66-22d668880183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:34 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Volume b69fffa6-6610-46bd-842d-4c965720148c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b69fffa6-6610-46bd-842d-4c965720148c', 'volume_size': 1}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1039290095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b69fffa6-6610-46bd-842d-4c965720148c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='042255896911426a95420543d4387c55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:34Z,use_quota=True,user_id='8b16a577b8e74bebb622e29e474ddeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Creating volume b69fffa6-6610-46bd-842d-4c965720148c {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:17:34 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:17:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:34 devstack sudo[84190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c 1073741824
Apr 28 02:17:34 devstack sudo[84190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:35 devstack sudo[84190]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c 1073741824" returned: 0 in 0.787s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:35 devstack sudo[84213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c
Apr 28 02:17:35 devstack sudo[84213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:35 devstack sudo[84213]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c" returned: 0 in 0.531s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:17:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:35 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:UPDATE=101,cinder:SELECT=88,cinder:INSERT=36,cinder:DELETE=6 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:17:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba5a0bd-2320-49a5-ba66-22d668880183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b69fffa6-6610-46bd-842d-4c965720148c', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42501503-9ed7-49e1-993b-84c1fda1e3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:35 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=87,cinder:UPDATE=85,cinder:INSERT=27,cinder:DELETE=9 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:17:35 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Volume volume-b69fffa6-6610-46bd-842d-4c965720148c (b69fffa6-6610-46bd-842d-4c965720148c): created successfully
Apr 28 02:17:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42501503-9ed7-49e1-993b-84c1fda1e3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Flow 'volume_create_manager' (1fa20921-d317-4932-b8bc-608add5c34fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:35 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-dc4e54ba-b290-4096-8ac6-76d0cdea46ab tempest-SnapshotMetadataTestJSON-1339160041 None] Created volume successfully.
Apr 28 02:17:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] Creating offline snapshot 51a8b383-0f88-4998-9b3d-2a93ee965bc5 of volume b69fffa6-6610-46bd-842d-4c965720148c {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:17:36 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdd47b3-a269-4a6f-a2c4-5c67eaf22a85]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:36 devstack sudo[84224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c
Apr 28 02:17:36 devstack sudo[84224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:37 devstack sudo[84224]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c" returned: 0 in 0.604s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:37 devstack sudo[84238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5 1G
Apr 28 02:17:37 devstack sudo[84238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Flow 'volume_create_manager' (18eed40b-f739-4593-92e8-82682cee59ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8d16d8-8419-4e12-a7d7-5e70d7c21749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8d16d8-8419-4e12-a7d7-5e70d7c21749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-214399996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3234ff-de95-4b46-935a-4dd95dddee81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81a6c2ce691424e84026cf0f2b11164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:38Z,use_quota=True,user_id='16e2ec2964ca405986d95259947086d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e338fe3-fb99-4c4c-8af1-d1d9b7a6ca55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e338fe3-fb99-4c4c-8af1-d1d9b7a6ca55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98656897-f0a1-4877-a843-0abd8b5c0e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98656897-f0a1-4877-a843-0abd8b5c0e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f3234ff-de95-4b46-935a-4dd95dddee81', 'volume_name': 'volume-9f3234ff-de95-4b46-935a-4dd95dddee81', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb38d01-bcfa-48b4-ae2a-4835406c5cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb38d01-bcfa-48b4-ae2a-4835406c5cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33a755c-1d18-4c05-aedb-e9b401bcc2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:37 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Volume 9f3234ff-de95-4b46-935a-4dd95dddee81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f3234ff-de95-4b46-935a-4dd95dddee81', 'volume_size': 1}
Apr 28 02:17:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:38 devstack sudo[84238]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5 1G" returned: 0 in 0.752s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b69fffa6-6610-46bd-842d-4c965720148c -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:38 devstack sudo[84244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b69fffa6-6610-46bd-842d-4c965720148c -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5
Apr 28 02:17:38 devstack sudo[84244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:38 devstack sudo[84244]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b69fffa6-6610-46bd-842d-4c965720148c -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5" returned: 0 in 0.560s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:38 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5 is being set with open permissions: ugo+rw
Apr 28 02:17:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:38 devstack sudo[84249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5
Apr 28 02:17:38 devstack sudo[84249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:39 devstack sudo[84249]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5" returned: 0 in 0.567s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:39 devstack sudo[84252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.info
Apr 28 02:17:39 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:39 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.info" returned: 0 in 0.497s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:39 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.info is being set with open permissions: ugo+rw
Apr 28 02:17:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:39 devstack sudo[84268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.info
Apr 28 02:17:39 devstack sudo[84268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:40 devstack sudo[84268]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.info" returned: 0 in 0.512s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.596s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.765s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-214399996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f3234ff-de95-4b46-935a-4dd95dddee81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81a6c2ce691424e84026cf0f2b11164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:38Z,use_quota=True,user_id='16e2ec2964ca405986d95259947086d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:17:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Creating volume 9f3234ff-de95-4b46-935a-4dd95dddee81 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:17:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:17:40 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:17:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9f3234ff-de95-4b46-935a-4dd95dddee81 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:40 devstack sudo[84277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9f3234ff-de95-4b46-935a-4dd95dddee81 1073741824
Apr 28 02:17:40 devstack sudo[84277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:40 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-efd2b18f-4d31-44b9-b1e8-352bf49d5ff4 tempest-SnapshotMetadataTestJSON-1339160041 None] Create snapshot completed successfully
Apr 28 02:17:41 devstack sudo[84277]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9f3234ff-de95-4b46-935a-4dd95dddee81 1073741824" returned: 0 in 0.641s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9f3234ff-de95-4b46-935a-4dd95dddee81 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:41 devstack sudo[84282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9f3234ff-de95-4b46-935a-4dd95dddee81
Apr 28 02:17:41 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:41 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9f3234ff-de95-4b46-935a-4dd95dddee81" returned: 0 in 0.559s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33a755c-1d18-4c05-aedb-e9b401bcc2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f3234ff-de95-4b46-935a-4dd95dddee81', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1425d807-64fa-4b8e-b972-078d28f4250d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:41 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Volume volume-9f3234ff-de95-4b46-935a-4dd95dddee81 (9f3234ff-de95-4b46-935a-4dd95dddee81): created successfully
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1425d807-64fa-4b8e-b972-078d28f4250d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Flow 'volume_create_manager' (18eed40b-f739-4593-92e8-82682cee59ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:41 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-5de536c1-1bfc-48b3-ac87-08f20342f7b3 tempest-VolumesTransfersV357Test-1751242299 None] Created volume successfully.
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Acquiring lock "cinder-51a8b383-0f88-4998-9b3d-2a93ee965bc5-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "cinder-51a8b383-0f88-4998-9b3d-2a93ee965bc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Acquiring lock "cinder-quobyte-b69fffa6-6610-46bd-842d-4c965720148c" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "cinder-quobyte-b69fffa6-6610-46bd-842d-4c965720148c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Acquiring lock "cinder-quobyte-51a8b383-0f88-4998-9b3d-2a93ee965bc5" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "cinder-quobyte-51a8b383-0f88-4998-9b3d-2a93ee965bc5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Deleting offline snapshot 51a8b383-0f88-4998-9b3d-2a93ee965bc5 of volume b69fffa6-6610-46bd-842d-4c965720148c {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:17:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] snapshot_file for this snap is: volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:17:42 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd2bdf1-3771-407d-b7a3-3fe9b1e763d2]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:42 devstack sudo[84291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5
Apr 28 02:17:42 devstack sudo[84291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:42 devstack sudo[84291]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5" returned: 0 in 0.550s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b69fffa6-6610-46bd-842d-4c965720148c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:17:42 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a902d13-8089-45c8-a339-4475e4a0b14c]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:42 devstack sudo[84304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c
Apr 28 02:17:42 devstack sudo[84304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:43 devstack sudo[84304]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c" returned: 0 in 0.955s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:43 devstack sudo[84346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5
Apr 28 02:17:43 devstack sudo[84346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:43 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d282e7bc-3c16-43c0-862d-c41c3d126d38 tempest-VolumesTransfersV357Test-1533750057 None] Transfer volume completed successfully.
Apr 28 02:17:44 devstack sudo[84346]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5" returned: 0 in 0.859s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:44 devstack sudo[84352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5
Apr 28 02:17:44 devstack sudo[84352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Acquiring lock "cinder-9f3234ff-de95-4b46-935a-4dd95dddee81-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Lock "cinder-9f3234ff-de95-4b46-935a-4dd95dddee81-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Acquiring lock "cinder-quobyte-9f3234ff-de95-4b46-935a-4dd95dddee81" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Lock "cinder-quobyte-9f3234ff-de95-4b46-935a-4dd95dddee81" acquired by "delete_volume" :: waited 0.037s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:45 devstack sudo[84352]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c.51a8b383-0f88-4998-9b3d-2a93ee965bc5" returned: 0 in 1.068s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:45 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[732821b6-4f8c-46a1-9f33-fd0d9df03547]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9f3234ff-de95-4b46-935a-4dd95dddee81 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "cinder-quobyte-51a8b383-0f88-4998-9b3d-2a93ee965bc5" released by "_delete_snapshot" :: held 3.629s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "cinder-quobyte-b69fffa6-6610-46bd-842d-4c965720148c" released by "delete_snapshot" :: held 3.675s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:45 devstack sudo[84401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9f3234ff-de95-4b46-935a-4dd95dddee81
Apr 28 02:17:45 devstack sudo[84401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:45 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Created reservations ['180e1701-7390-4ad3-bd08-35dd49630680', 'fb62976d-cfc5-4e97-8ec5-ac2915b79b6b', 'fd95be21-6d98-440c-84c9-62fdf7ad5019', '2e4aecc5-db1d-4c9b-83a5-a38753ef997a'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:17:45 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Delete snapshot completed successfully.
Apr 28 02:17:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1a27618c-6bdb-40c3-baa2-3176173598be tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "cinder-51a8b383-0f88-4998-9b3d-2a93ee965bc5-delete_snapshot" released by "delete_snapshot" :: held 3.996s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Acquiring lock "cinder-b69fffa6-6610-46bd-842d-4c965720148c-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "cinder-b69fffa6-6610-46bd-842d-4c965720148c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Acquiring lock "cinder-quobyte-b69fffa6-6610-46bd-842d-4c965720148c" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "cinder-quobyte-b69fffa6-6610-46bd-842d-4c965720148c" acquired by "delete_volume" :: waited 0.071s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:46 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2682bc-64ea-47ab-82ce-ac11b8db7cf2]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:46 devstack sudo[84438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c
Apr 28 02:17:46 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:47 devstack sudo[84401]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9f3234ff-de95-4b46-935a-4dd95dddee81" returned: 0 in 1.433s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9f3234ff-de95-4b46-935a-4dd95dddee81 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:47 devstack sudo[84443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9f3234ff-de95-4b46-935a-4dd95dddee81
Apr 28 02:17:47 devstack sudo[84443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:48 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c" returned: 0 in 1.282s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:48 devstack sudo[84450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c
Apr 28 02:17:48 devstack sudo[84450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:48 devstack sudo[84443]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9f3234ff-de95-4b46-935a-4dd95dddee81" returned: 0 in 1.275s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Lock "cinder-quobyte-9f3234ff-de95-4b46-935a-4dd95dddee81" released by "delete_volume" :: held 2.880s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:48 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Created reservations ['789dae4d-9c05-4386-8e00-21fe0719cbd5', '14d5c1b7-01e1-4a5a-b991-ea0f730cb244', '3fa89c9f-c0e8-49f3-bd22-b9f182af31f9', '8967b2c8-a9a5-4445-a588-7ca88fd20e95'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:17:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:48 devstack sudo[84453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:17:48 devstack sudo[84453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:49 devstack sudo[84450]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b69fffa6-6610-46bd-842d-4c965720148c" returned: 0 in 0.992s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "cinder-quobyte-b69fffa6-6610-46bd-842d-4c965720148c" released by "delete_volume" :: held 2.444s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:49 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Created reservations ['ba43b953-2628-47b0-8e59-ccc27f32e7c7', '5d18ab55-79c9-44bd-a36e-8c4a9e5ac1b1', '77fe2551-1f5f-4672-803b-139b88864182', '0eee79ec-3822-4310-9cf2-50153bf7eb20'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:17:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:49 devstack sudo[84461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:17:49 devstack sudo[84461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:49 devstack sudo[84453]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.437s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:49 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:17:49 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Deleted volume successfully.
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-56022f8a-3dfe-4cb5-9031-dc0905fd97e4 tempest-VolumesTransfersV357Test-259517680 None] Lock "cinder-9f3234ff-de95-4b46-935a-4dd95dddee81-delete_volume" released by "delete_volume" :: held 4.755s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Flow 'volume_create_manager' (4e0af39c-788c-40ab-bce2-8f494ff35b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095be056-056d-4c20-a26d-73a7c5b4eba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095be056-056d-4c20-a26d-73a7c5b4eba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-25906614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0862a8-22f6-48b3-a36c-3165b3034bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81a6c2ce691424e84026cf0f2b11164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:50Z,use_quota=True,user_id='16e2ec2964ca405986d95259947086d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f51131-c646-4ce2-b053-fc1006168bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f51131-c646-4ce2-b053-fc1006168bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b8969f-9bc3-4851-98f7-796e8942b83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b8969f-9bc3-4851-98f7-796e8942b83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d0862a8-22f6-48b3-a36c-3165b3034bac', 'volume_name': 'volume-0d0862a8-22f6-48b3-a36c-3165b3034bac', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39f46d9-e762-43e6-a48b-501b78644baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39f46d9-e762-43e6-a48b-501b78644baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce42dae1-e802-477e-a76d-be890005def4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:50 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Volume 0d0862a8-22f6-48b3-a36c-3165b3034bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d0862a8-22f6-48b3-a36c-3165b3034bac', 'volume_size': 1}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-25906614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d0862a8-22f6-48b3-a36c-3165b3034bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81a6c2ce691424e84026cf0f2b11164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:50Z,use_quota=True,user_id='16e2ec2964ca405986d95259947086d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Creating volume 0d0862a8-22f6-48b3-a36c-3165b3034bac {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:17:50 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0d0862a8-22f6-48b3-a36c-3165b3034bac 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:50 devstack sudo[84488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0d0862a8-22f6-48b3-a36c-3165b3034bac 1073741824
Apr 28 02:17:50 devstack sudo[84488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:50 devstack sudo[84461]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.599s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:50 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:17:51 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Deleted volume successfully.
Apr 28 02:17:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7f92b39b-2b49-4a2e-b7d4-cb060867d9ce tempest-SnapshotMetadataTestJSON-1339160041 None] Lock "cinder-b69fffa6-6610-46bd-842d-4c965720148c-delete_volume" released by "delete_volume" :: held 4.603s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:51 devstack sudo[84488]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0d0862a8-22f6-48b3-a36c-3165b3034bac 1073741824" returned: 0 in 1.480s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0d0862a8-22f6-48b3-a36c-3165b3034bac {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:52 devstack sudo[84510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0d0862a8-22f6-48b3-a36c-3165b3034bac
Apr 28 02:17:52 devstack sudo[84510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:17:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:52 devstack sudo[84524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:17:52 devstack sudo[84524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:53 devstack sudo[84510]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0d0862a8-22f6-48b3-a36c-3165b3034bac" returned: 0 in 1.111s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] <== create_volume: return (2656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:17:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.662s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:53 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce42dae1-e802-477e-a76d-be890005def4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d0862a8-22f6-48b3-a36c-3165b3034bac', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:53 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57114a67-fd25-4d41-aeea-064f252d2cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:53 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Volume volume-0d0862a8-22f6-48b3-a36c-3165b3034bac (0d0862a8-22f6-48b3-a36c-3165b3034bac): created successfully
Apr 28 02:17:53 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57114a67-fd25-4d41-aeea-064f252d2cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:53 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Flow 'volume_create_manager' (4e0af39c-788c-40ab-bce2-8f494ff35b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:53 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-24268543-7eaf-42e8-84c4-b1187fa8299e tempest-VolumesTransfersV357Test-1751242299 None] Created volume successfully.
Apr 28 02:17:54 devstack sudo[84524]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.848s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:54 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:17:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Acquiring lock "cinder-0d0862a8-22f6-48b3-a36c-3165b3034bac-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Lock "cinder-0d0862a8-22f6-48b3-a36c-3165b3034bac-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Acquiring lock "cinder-quobyte-0d0862a8-22f6-48b3-a36c-3165b3034bac" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:17:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Lock "cinder-quobyte-0d0862a8-22f6-48b3-a36c-3165b3034bac" acquired by "delete_volume" :: waited 0.040s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:17:55 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[27585196-929a-4184-859e-1cf7997b30da]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:17:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0d0862a8-22f6-48b3-a36c-3165b3034bac {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:55 devstack sudo[84556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0d0862a8-22f6-48b3-a36c-3165b3034bac
Apr 28 02:17:55 devstack sudo[84556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Flow 'volume_create_manager' (fc027cac-a8b4-46ba-857d-e63dfad20252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d177d652-5d51-48b8-855a-4c41457be13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d177d652-5d51-48b8-855a-4c41457be13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1619293811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78cd3709-0238-45fb-b36d-2cecf86c1449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4839396b15014e4384aa0cc21f7b8171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:56Z,use_quota=True,user_id='eec2264c01ce4e3c8ae7777395331387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7b19a5-44eb-4913-b22f-907460829220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7b19a5-44eb-4913-b22f-907460829220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fb5e0b-dfbc-464b-86b5-b48105ad7451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fb5e0b-dfbc-464b-86b5-b48105ad7451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78cd3709-0238-45fb-b36d-2cecf86c1449', 'volume_name': 'volume-78cd3709-0238-45fb-b36d-2cecf86c1449', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18d4132-6615-4da2-8a9b-f937b56bbb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18d4132-6615-4da2-8a9b-f937b56bbb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a438784-4ce4-461e-b289-e5aaccc58299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:56 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Volume 78cd3709-0238-45fb-b36d-2cecf86c1449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78cd3709-0238-45fb-b36d-2cecf86c1449', 'volume_size': 1}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1619293811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78cd3709-0238-45fb-b36d-2cecf86c1449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4839396b15014e4384aa0cc21f7b8171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:17:56Z,use_quota=True,user_id='eec2264c01ce4e3c8ae7777395331387',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Creating volume 78cd3709-0238-45fb-b36d-2cecf86c1449 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:17:56 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-78cd3709-0238-45fb-b36d-2cecf86c1449 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:56 devstack sudo[84562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-78cd3709-0238-45fb-b36d-2cecf86c1449 1073741824
Apr 28 02:17:56 devstack sudo[84562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:56 devstack sudo[84556]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0d0862a8-22f6-48b3-a36c-3165b3034bac" returned: 0 in 1.800s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0d0862a8-22f6-48b3-a36c-3165b3034bac {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:56 devstack sudo[84566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0d0862a8-22f6-48b3-a36c-3165b3034bac
Apr 28 02:17:56 devstack sudo[84566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:57 devstack sudo[84566]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0d0862a8-22f6-48b3-a36c-3165b3034bac" returned: 0 in 0.808s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Lock "cinder-quobyte-0d0862a8-22f6-48b3-a36c-3165b3034bac" released by "delete_volume" :: held 2.705s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:17:57 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Created reservations ['859fc8fd-c1fd-416e-94da-1d46166b0adb', '8b7977cf-06ec-48df-8284-09c1242331cf', 'fd6fabb0-0866-4599-a54e-f4996a2487a8', '344098f5-909d-4351-b7ce-f2dd67325639'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:17:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:17:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:17:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:17:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:17:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:57 devstack sudo[84579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:17:57 devstack sudo[84579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:57 devstack sudo[84562]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-78cd3709-0238-45fb-b36d-2cecf86c1449 1073741824" returned: 0 in 1.436s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-78cd3709-0238-45fb-b36d-2cecf86c1449 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:17:58 devstack sudo[84584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-78cd3709-0238-45fb-b36d-2cecf86c1449
Apr 28 02:17:58 devstack sudo[84584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:17:59 devstack sudo[84584]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-78cd3709-0238-45fb-b36d-2cecf86c1449" returned: 0 in 1.160s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] <== create_volume: return (2665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:17:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.668s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:17:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a438784-4ce4-461e-b289-e5aaccc58299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78cd3709-0238-45fb-b36d-2cecf86c1449', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a720bf9-74d3-476f-8e18-ce0873e0b3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:17:59 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Volume volume-78cd3709-0238-45fb-b36d-2cecf86c1449 (78cd3709-0238-45fb-b36d-2cecf86c1449): created successfully
Apr 28 02:17:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a720bf9-74d3-476f-8e18-ce0873e0b3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:17:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Flow 'volume_create_manager' (fc027cac-a8b4-46ba-857d-e63dfad20252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:17:59 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a3e21def-ad7d-457c-b701-1fbc9fa40726 tempest-VolumesMetadataTest-1032103599 None] Created volume successfully.
Apr 28 02:17:59 devstack sudo[84579]: pam_unix(sudo:session): session closed for user root
Apr 28 02:17:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.351s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:17:59 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:17:59 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Deleted volume successfully.
Apr 28 02:17:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-cabb1257-cc2d-4f3f-9b53-a66d83961e78 tempest-VolumesTransfersV357Test-259517680 None] Lock "cinder-0d0862a8-22f6-48b3-a36c-3165b3034bac-delete_volume" released by "delete_volume" :: held 4.555s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:00 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Acquiring lock "cinder-78cd3709-0238-45fb-b36d-2cecf86c1449-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:00 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Lock "cinder-78cd3709-0238-45fb-b36d-2cecf86c1449-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:00 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Acquiring lock "cinder-quobyte-78cd3709-0238-45fb-b36d-2cecf86c1449" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:00 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Lock "cinder-quobyte-78cd3709-0238-45fb-b36d-2cecf86c1449" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:00 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bcbb5d-51b2-4116-a390-153541ca49d8]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:18:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-78cd3709-0238-45fb-b36d-2cecf86c1449 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:01 devstack sudo[84643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-78cd3709-0238-45fb-b36d-2cecf86c1449
Apr 28 02:18:01 devstack sudo[84643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:01 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-1b42c875-69c4-4bac-be38-60700c17855f req-1839f88a-9ad8-4a3f-8758-782413ba1983 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Terminate volume connection completed successfully.
Apr 28 02:18:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-1b42c875-69c4-4bac-be38-60700c17855f req-1839f88a-9ad8-4a3f-8758-782413ba1983 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Deleting attachment ecca524d-029c-4904-86dd-85ccb633e2d9. {{(pid=81489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 28 02:18:01 devstack sudo[84643]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-78cd3709-0238-45fb-b36d-2cecf86c1449" returned: 0 in 0.684s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-78cd3709-0238-45fb-b36d-2cecf86c1449 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:01 devstack sudo[84653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-78cd3709-0238-45fb-b36d-2cecf86c1449
Apr 28 02:18:01 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Acquiring lock "cinder-0f516817-2d91-419a-a5b0-004304e47d86-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "cinder-0f516817-2d91-419a-a5b0-004304e47d86-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Acquiring lock "cinder-quobyte-0f516817-2d91-419a-a5b0-004304e47d86" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "cinder-quobyte-0f516817-2d91-419a-a5b0-004304e47d86" acquired by "delete_volume" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4912b56c-1b6c-45d2-a7f4-5559983d3f18]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:02 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-78cd3709-0238-45fb-b36d-2cecf86c1449" returned: 0 in 0.707s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Lock "cinder-quobyte-78cd3709-0238-45fb-b36d-2cecf86c1449" released by "delete_volume" :: held 1.486s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:02 devstack sudo[84667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86
Apr 28 02:18:02 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Created reservations ['86101895-ef6a-430f-97d1-11b43317f067', '199fbfb2-7722-415c-918b-69e8cd154d1f', '4bcbce8b-9235-48a4-8a0b-2790025bd255', '0659a90c-23f6-41fa-acba-056b23c737b6'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:02 devstack sudo[84669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:18:02 devstack sudo[84669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:03 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86" returned: 0 in 0.764s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:03 devstack sudo[84675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86
Apr 28 02:18:03 devstack sudo[84675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:03 devstack sudo[84669]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.669s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:03 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:18:03 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Deleted volume successfully.
Apr 28 02:18:03 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b1f946e8-110e-45f2-97a7-23406b9eb7a1 tempest-VolumesMetadataTest-1032103599 None] Lock "cinder-78cd3709-0238-45fb-b36d-2cecf86c1449-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:03 devstack sudo[84675]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86" returned: 1 in 0.711s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:18:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:03 devstack sudo[84681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86
Apr 28 02:18:03 devstack sudo[84681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:04 devstack sudo[84681]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0f516817-2d91-419a-a5b0-004304e47d86" returned: 0 in 0.638s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "cinder-quobyte-0f516817-2d91-419a-a5b0-004304e47d86" released by "delete_volume" :: held 2.274s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:04 devstack cinder-volume[81489]: DEBUG cinder.quota [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Created reservations ['e5c73b70-fa86-4c4a-880a-af6a736a07ba', '227560f8-a46f-4d79-8ea8-f12f1490baf8', '244f3861-c755-40cb-8366-bc6cf6e7adde', '405e039d-ca1c-49c8-ba0f-3ca6bb9e4b1e'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:18:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:04 devstack sudo[84684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:18:04 devstack sudo[84684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:05 devstack sudo[84684]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.582s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:05 devstack cinder-volume[81489]: DEBUG cinder.manager [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:18:05 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Deleted volume successfully.
Apr 28 02:18:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-1b42c875-69c4-4bac-be38-60700c17855f req-6b221b06-5184-450c-b6ee-8f6428a68169 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "cinder-0f516817-2d91-419a-a5b0-004304e47d86-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Flow 'volume_create_manager' (14bbbeac-23c7-4d9d-a98b-d806e9ffb880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c59602-749e-4703-8be5-879005f1460b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c59602-749e-4703-8be5-879005f1460b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2013046463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c4cbea-c73a-40df-afc9-3084dbc551af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa05812ba00046919dd095b2568e877b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:09Z,use_quota=True,user_id='359dd8c74ce144fb9e4d43b8d97d38d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d618e15-a3a0-47da-bb75-59f8466fb8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d618e15-a3a0-47da-bb75-59f8466fb8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f516c9-d631-4f12-bd79-e225fee3f547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15f516c9-d631-4f12-bd79-e225fee3f547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c4cbea-c73a-40df-afc9-3084dbc551af', 'volume_name': 'volume-b4c4cbea-c73a-40df-afc9-3084dbc551af', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c2487c-1928-4707-8665-a78bfba7d242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c2487c-1928-4707-8665-a78bfba7d242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbd7e14-99cc-4d98-b817-6314ecba342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:08 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Volume b4c4cbea-c73a-40df-afc9-3084dbc551af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c4cbea-c73a-40df-afc9-3084dbc551af', 'volume_size': 1}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2013046463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c4cbea-c73a-40df-afc9-3084dbc551af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa05812ba00046919dd095b2568e877b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:09Z,use_quota=True,user_id='359dd8c74ce144fb9e4d43b8d97d38d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Creating volume b4c4cbea-c73a-40df-afc9-3084dbc551af {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:18:08 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:18:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b4c4cbea-c73a-40df-afc9-3084dbc551af 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:08 devstack sudo[84759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b4c4cbea-c73a-40df-afc9-3084dbc551af 1073741824
Apr 28 02:18:08 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:09 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b4c4cbea-c73a-40df-afc9-3084dbc551af 1073741824" returned: 0 in 0.834s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b4c4cbea-c73a-40df-afc9-3084dbc551af {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:09 devstack sudo[84781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b4c4cbea-c73a-40df-afc9-3084dbc551af
Apr 28 02:18:09 devstack sudo[84781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:10 devstack sudo[84781]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b4c4cbea-c73a-40df-afc9-3084dbc551af" returned: 0 in 0.744s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:18:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbd7e14-99cc-4d98-b817-6314ecba342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c4cbea-c73a-40df-afc9-3084dbc551af', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d7f83a-48da-45e8-bce1-a4294214ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:10 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Volume volume-b4c4cbea-c73a-40df-afc9-3084dbc551af (b4c4cbea-c73a-40df-afc9-3084dbc551af): created successfully
Apr 28 02:18:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d7f83a-48da-45e8-bce1-a4294214ba91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Flow 'volume_create_manager' (14bbbeac-23c7-4d9d-a98b-d806e9ffb880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:10 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3a5beb1b-ed9d-49f2-84c3-2423eea7aeec tempest-VolumesTransfersV355Test-826360342 None] Created volume successfully.
Apr 28 02:18:11 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6f88ebc1-3a61-4578-9176-f8880aecf675 tempest-VolumesTransfersV355Test-459093818 None] Transfer volume completed successfully.
Apr 28 02:18:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Acquiring lock "cinder-b4c4cbea-c73a-40df-afc9-3084dbc551af-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Lock "cinder-b4c4cbea-c73a-40df-afc9-3084dbc551af-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Acquiring lock "cinder-quobyte-b4c4cbea-c73a-40df-afc9-3084dbc551af" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Lock "cinder-quobyte-b4c4cbea-c73a-40df-afc9-3084dbc551af" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:12 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87679a5-9c8d-4967-ad46-e5d0c5eee120]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:18:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b4c4cbea-c73a-40df-afc9-3084dbc551af {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:13 devstack sudo[84790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b4c4cbea-c73a-40df-afc9-3084dbc551af
Apr 28 02:18:13 devstack sudo[84790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:13 devstack sudo[84790]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b4c4cbea-c73a-40df-afc9-3084dbc551af" returned: 0 in 0.783s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b4c4cbea-c73a-40df-afc9-3084dbc551af {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:13 devstack sudo[84828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b4c4cbea-c73a-40df-afc9-3084dbc551af
Apr 28 02:18:13 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:14 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b4c4cbea-c73a-40df-afc9-3084dbc551af" returned: 0 in 0.673s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Lock "cinder-quobyte-b4c4cbea-c73a-40df-afc9-3084dbc551af" released by "delete_volume" :: held 1.522s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:14 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Created reservations ['a3279544-710d-4d2b-b07e-af9f3d66c65d', 'db157f2e-8345-4a43-b3ea-6d413130e794', 'b3ad8f97-e4bd-4dda-bfe7-82df5c281643', 'eea9248d-ce22-4bab-a0c9-ba2dab96ee0f'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:18:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:14 devstack sudo[84838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:18:14 devstack sudo[84838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:15 devstack sudo[84838]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.549s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:18:15 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Deleted volume successfully.
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a969f4e4-a1e3-455c-8e5d-fa694a7e9fcc tempest-VolumesTransfersV355Test-871578296 None] Lock "cinder-b4c4cbea-c73a-40df-afc9-3084dbc551af-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Flow 'volume_create_manager' (e7d163a7-c972-466d-a76a-d28314da01e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c7862b-8f0d-4afd-95d5-de1835204767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c7862b-8f0d-4afd-95d5-de1835204767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-170177212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8b358e-55ce-49d2-b440-e4293b9419fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa05812ba00046919dd095b2568e877b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:16Z,use_quota=True,user_id='359dd8c74ce144fb9e4d43b8d97d38d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364360bb-34e8-4c6b-bf45-0317990209ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364360bb-34e8-4c6b-bf45-0317990209ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e550361-117b-435c-ac41-30c70f9b77b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e550361-117b-435c-ac41-30c70f9b77b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf8b358e-55ce-49d2-b440-e4293b9419fe', 'volume_name': 'volume-bf8b358e-55ce-49d2-b440-e4293b9419fe', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e0370b-dfb2-43de-b378-ded9aa4bd2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e0370b-dfb2-43de-b378-ded9aa4bd2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02bd5e54-41be-4784-973a-8c8270158dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:15 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Volume bf8b358e-55ce-49d2-b440-e4293b9419fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf8b358e-55ce-49d2-b440-e4293b9419fe', 'volume_size': 1}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-170177212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8b358e-55ce-49d2-b440-e4293b9419fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa05812ba00046919dd095b2568e877b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:16Z,use_quota=True,user_id='359dd8c74ce144fb9e4d43b8d97d38d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Creating volume bf8b358e-55ce-49d2-b440-e4293b9419fe {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:18:15 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:18:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bf8b358e-55ce-49d2-b440-e4293b9419fe 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:15 devstack sudo[84850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bf8b358e-55ce-49d2-b440-e4293b9419fe 1073741824
Apr 28 02:18:15 devstack sudo[84850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:16 devstack sudo[84850]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bf8b358e-55ce-49d2-b440-e4293b9419fe 1073741824" returned: 0 in 0.912s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bf8b358e-55ce-49d2-b440-e4293b9419fe {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:16 devstack sudo[84870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bf8b358e-55ce-49d2-b440-e4293b9419fe
Apr 28 02:18:16 devstack sudo[84870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:17 devstack sudo[84870]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bf8b358e-55ce-49d2-b440-e4293b9419fe" returned: 0 in 0.662s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:18:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02bd5e54-41be-4784-973a-8c8270158dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf8b358e-55ce-49d2-b440-e4293b9419fe', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c50118-7985-43d2-9297-ac6df6c4bd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:17 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Volume volume-bf8b358e-55ce-49d2-b440-e4293b9419fe (bf8b358e-55ce-49d2-b440-e4293b9419fe): created successfully
Apr 28 02:18:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c50118-7985-43d2-9297-ac6df6c4bd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Flow 'volume_create_manager' (e7d163a7-c972-466d-a76a-d28314da01e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:17 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d54a6320-6d84-44de-a2b5-e1df60ea3686 tempest-VolumesTransfersV355Test-826360342 None] Created volume successfully.
Apr 28 02:18:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Acquiring lock "cinder-bf8b358e-55ce-49d2-b440-e4293b9419fe-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Lock "cinder-bf8b358e-55ce-49d2-b440-e4293b9419fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Acquiring lock "cinder-quobyte-bf8b358e-55ce-49d2-b440-e4293b9419fe" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Lock "cinder-quobyte-bf8b358e-55ce-49d2-b440-e4293b9419fe" acquired by "delete_volume" :: waited 0.068s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:18 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8868cc30-c4f1-4ce2-9cd7-af3bb8b2912e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:18:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bf8b358e-55ce-49d2-b440-e4293b9419fe {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:18 devstack sudo[84879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bf8b358e-55ce-49d2-b440-e4293b9419fe
Apr 28 02:18:18 devstack sudo[84879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Flow 'volume_create_manager' (01da9f12-6a00-40a5-821e-c1ae69abe4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dcbbd22-9ff0-47b8-b939-af1ad1cc828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dcbbd22-9ff0-47b8-b939-af1ad1cc828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1327367336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776d4fe0-3bff-4403-9889-b8229813ffe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0097398292714cceaf98461eb983e166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:19Z,use_quota=True,user_id='04f3a1082210419b99020f7ab4380452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d2b017-7499-4a98-8087-ad6b83c9de25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d2b017-7499-4a98-8087-ad6b83c9de25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5a3307-7019-4475-b9f4-bc22486dda00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e5a3307-7019-4475-b9f4-bc22486dda00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '776d4fe0-3bff-4403-9889-b8229813ffe2', 'volume_name': 'volume-776d4fe0-3bff-4403-9889-b8229813ffe2', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052c7711-c90d-48a9-a847-563ffd7e9a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (052c7711-c90d-48a9-a847-563ffd7e9a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fb1da6-8cf3-4fb3-ace2-8e2849060e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:19 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Volume 776d4fe0-3bff-4403-9889-b8229813ffe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-776d4fe0-3bff-4403-9889-b8229813ffe2', 'volume_size': 1}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1327367336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776d4fe0-3bff-4403-9889-b8229813ffe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0097398292714cceaf98461eb983e166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:19Z,use_quota=True,user_id='04f3a1082210419b99020f7ab4380452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Creating volume 776d4fe0-3bff-4403-9889-b8229813ffe2 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:18:19 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:19 devstack sudo[84883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 1073741824
Apr 28 02:18:19 devstack sudo[84883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:19 devstack sudo[84879]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bf8b358e-55ce-49d2-b440-e4293b9419fe" returned: 0 in 0.820s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bf8b358e-55ce-49d2-b440-e4293b9419fe {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:19 devstack sudo[84888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bf8b358e-55ce-49d2-b440-e4293b9419fe
Apr 28 02:18:19 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:19 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-e09c6436-5457-48fe-b6b2-19a87470a6b6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Terminate volume connection completed successfully.
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-e09c6436-5457-48fe-b6b2-19a87470a6b6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Deleting attachment cf802b93-caab-4e5e-a391-6881c3be0a2b. {{(pid=81489) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 28 02:18:19 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bf8b358e-55ce-49d2-b440-e4293b9419fe" returned: 0 in 0.543s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:19 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Lock "cinder-quobyte-bf8b358e-55ce-49d2-b440-e4293b9419fe" released by "delete_volume" :: held 1.420s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Created reservations ['8e8738f8-9b35-44bc-9b52-9ba5d8b47c7a', '986d339e-6c98-4085-8c83-09b8355aa852', '08a298bd-5470-4e05-9dd9-4444fe9e6ba6', 'b9480c67-3962-4e52-96d9-9c5407585348'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:18:20 devstack sudo[84883]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 1073741824" returned: 0 in 0.863s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:20 devstack sudo[84895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2
Apr 28 02:18:20 devstack sudo[84895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:20 devstack sudo[84898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:18:20 devstack sudo[84898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Acquiring lock "cinder-5636af77-084d-48af-9e3f-2c1ab6305b32-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "cinder-5636af77-084d-48af-9e3f-2c1ab6305b32-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Acquiring lock "cinder-quobyte-5636af77-084d-48af-9e3f-2c1ab6305b32" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "cinder-quobyte-5636af77-084d-48af-9e3f-2c1ab6305b32" acquired by "delete_volume" :: waited 0.046s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7910f659-3b8a-4e9e-9a4a-5c8e7aa1930d]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:20 devstack sudo[84895]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2" returned: 0 in 0.734s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:20 devstack sudo[84901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32
Apr 28 02:18:20 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fb1da6-8cf3-4fb3-ace2-8e2849060e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-776d4fe0-3bff-4403-9889-b8229813ffe2', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3053557-3de5-4ae2-9a3f-cf790bd5e7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:20 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Volume volume-776d4fe0-3bff-4403-9889-b8229813ffe2 (776d4fe0-3bff-4403-9889-b8229813ffe2): created successfully
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3053557-3de5-4ae2-9a3f-cf790bd5e7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Flow 'volume_create_manager' (01da9f12-6a00-40a5-821e-c1ae69abe4dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:20 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-15c17c46-099b-4743-aca3-5ee1cf9180d4 tempest-VolumesActionsTest-1998942808 None] Created volume successfully.
Apr 28 02:18:20 devstack sudo[84898]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.798s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:18:20 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Deleted volume successfully.
Apr 28 02:18:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8ffc369e-5862-4ee3-8d59-3c73eff3e8e3 tempest-VolumesTransfersV355Test-871578296 None] Lock "cinder-bf8b358e-55ce-49d2-b440-e4293b9419fe-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:21 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32" returned: 0 in 0.880s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:21 devstack sudo[84923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32
Apr 28 02:18:21 devstack sudo[84923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:22 devstack sudo[84923]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5636af77-084d-48af-9e3f-2c1ab6305b32" returned: 0 in 0.751s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "cinder-quobyte-5636af77-084d-48af-9e3f-2c1ab6305b32" released by "delete_volume" :: held 1.718s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Flow 'volume_create_manager' (5504632b-1c1c-47f2-bd06-cfcf6b4459b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcef63e-854b-45ab-96bd-2545d1f1e635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcef63e-854b-45ab-96bd-2545d1f1e635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1442125801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea548195-8c93-4898-893e-86aa4b4b6360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab082d241edf4ef2a53182269603acd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:22Z,use_quota=True,user_id='dd9015dd95ff4da0a84b97806bf7bb9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784bf39d-8f85-45df-ac7a-f1774b5a7d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (784bf39d-8f85-45df-ac7a-f1774b5a7d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adf7166-fa08-46e6-9497-83d2ed5ffd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adf7166-fa08-46e6-9497-83d2ed5ffd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea548195-8c93-4898-893e-86aa4b4b6360', 'volume_name': 'volume-ea548195-8c93-4898-893e-86aa4b4b6360', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb22fbb-c7c3-40ee-90b0-703dcaa702d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb22fbb-c7c3-40ee-90b0-703dcaa702d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18b63a8-5a46-437e-8dee-27bf2f99092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:22 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Volume ea548195-8c93-4898-893e-86aa4b4b6360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea548195-8c93-4898-893e-86aa4b4b6360', 'volume_size': 1}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1442125801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea548195-8c93-4898-893e-86aa4b4b6360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab082d241edf4ef2a53182269603acd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:22Z,use_quota=True,user_id='dd9015dd95ff4da0a84b97806bf7bb9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Creating volume ea548195-8c93-4898-893e-86aa4b4b6360 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:18:22 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ea548195-8c93-4898-893e-86aa4b4b6360 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:22 devstack sudo[84930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ea548195-8c93-4898-893e-86aa4b4b6360 1073741824
Apr 28 02:18:22 devstack sudo[84930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.quota [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Created reservations ['b7a4cc93-ffd4-46a2-bf53-d4e2e97932b7', '35e713fc-89e5-4a1a-963a-015967cd4597', 'a0e4f7c0-7b14-480c-8cb9-cc53410ef69a', '334be2e8-e930-4e64-8f39-eccdc6a6d9f4'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:22 devstack sudo[84934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:18:22 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:23 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.576s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:23 devstack cinder-volume[81489]: DEBUG cinder.manager [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:18:23 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Deleted volume successfully.
Apr 28 02:18:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-ff66ee54-1ef4-4c7b-b9ad-8ace11d7aed6 req-d63e52c4-39b9-4259-ba02-9c708eff2de6 tempest-ServerBootFromVolumeStableRescueTest-752561324 None] Lock "cinder-5636af77-084d-48af-9e3f-2c1ab6305b32-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:23 devstack sudo[84930]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ea548195-8c93-4898-893e-86aa4b4b6360 1073741824" returned: 0 in 0.977s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ea548195-8c93-4898-893e-86aa4b4b6360 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:23 devstack sudo[84942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ea548195-8c93-4898-893e-86aa4b4b6360
Apr 28 02:18:23 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:24 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ea548195-8c93-4898-893e-86aa4b4b6360" returned: 0 in 0.712s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:18:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18b63a8-5a46-437e-8dee-27bf2f99092f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea548195-8c93-4898-893e-86aa4b4b6360', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89226677-909c-4bb6-8720-14264a2fadce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:24 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Volume volume-ea548195-8c93-4898-893e-86aa4b4b6360 (ea548195-8c93-4898-893e-86aa4b4b6360): created successfully
Apr 28 02:18:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89226677-909c-4bb6-8720-14264a2fadce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Flow 'volume_create_manager' (5504632b-1c1c-47f2-bd06-cfcf6b4459b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:24 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-7f471e9d-09ff-41ae-b8bd-73bf799fb74b tempest-ServersNegativeTestJSON-354499670 None] Created volume successfully.
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Flow 'volume_create_manager' (f6a50ae8-4447-495e-bd4e-3dd2b4365de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959c1b06-f560-44e3-8716-a97bac231d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959c1b06-f560-44e3-8716-a97bac231d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1072026721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3f53c1-78f2-441b-bcff-07c8bbee5762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab082d241edf4ef2a53182269603acd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:26Z,use_quota=True,user_id='dd9015dd95ff4da0a84b97806bf7bb9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ff3439-35ca-4789-935f-fc48ab0ce10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ff3439-35ca-4789-935f-fc48ab0ce10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333d53c0-f6d9-4d2e-8386-ddeb4972d9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333d53c0-f6d9-4d2e-8386-ddeb4972d9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f3f53c1-78f2-441b-bcff-07c8bbee5762', 'volume_name': 'volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c744f07a-7580-4035-a3ff-03c07a3ec8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c744f07a-7580-4035-a3ff-03c07a3ec8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a821d436-2bbd-454b-875e-aa56dbc00da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:26 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Volume 1f3f53c1-78f2-441b-bcff-07c8bbee5762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762', 'volume_size': 1}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1072026721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3f53c1-78f2-441b-bcff-07c8bbee5762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab082d241edf4ef2a53182269603acd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:26Z,use_quota=True,user_id='dd9015dd95ff4da0a84b97806bf7bb9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Creating volume 1f3f53c1-78f2-441b-bcff-07c8bbee5762 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:18:26 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:18:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:26 devstack sudo[84974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762 1073741824
Apr 28 02:18:26 devstack sudo[84974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:27 devstack sudo[84974]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762 1073741824" returned: 0 in 0.808s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:27 devstack sudo[84985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762
Apr 28 02:18:27 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:27 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762" returned: 0 in 0.506s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:18:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a821d436-2bbd-454b-875e-aa56dbc00da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd69f74-dafb-4296-9c79-197c9abf5ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:27 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Volume volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762 (1f3f53c1-78f2-441b-bcff-07c8bbee5762): created successfully
Apr 28 02:18:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd69f74-dafb-4296-9c79-197c9abf5ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Flow 'volume_create_manager' (f6a50ae8-4447-495e-bd4e-3dd2b4365de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:27 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-28d0d6e0-3f37-45b6-97c1-cf21e036be63 tempest-ServersNegativeTestJSON-354499670 None] Created volume successfully.
Apr 28 02:18:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Acquiring lock "cinder-1f3f53c1-78f2-441b-bcff-07c8bbee5762-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Lock "cinder-1f3f53c1-78f2-441b-bcff-07c8bbee5762-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Acquiring lock "cinder-quobyte-1f3f53c1-78f2-441b-bcff-07c8bbee5762" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Lock "cinder-quobyte-1f3f53c1-78f2-441b-bcff-07c8bbee5762" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:29 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abc9d07-1179-443f-b71b-0c61f999c2de]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:18:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:29 devstack sudo[84988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762
Apr 28 02:18:29 devstack sudo[84988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:30 devstack sudo[84988]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762" returned: 0 in 0.792s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:30 devstack sudo[84999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762
Apr 28 02:18:30 devstack sudo[84999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Flow 'volume_create_manager' (81b31b9d-8b4d-40ba-a022-ee8aeb44a0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b604afff-2653-4cf9-8038-9ad9cac0d69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b604afff-2653-4cf9-8038-9ad9cac0d69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1237056792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97657a73-d91a-4f51-ab9c-fe84e2fad45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ba51f3f0224e01b05adcd8b246fd95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:30Z,use_quota=True,user_id='e4717556ae7f43f181533abda2ce80ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0e5c9a-7ec9-4997-a59a-f5aaa156d295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0e5c9a-7ec9-4997-a59a-f5aaa156d295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20e11c7-2d29-4908-aecf-b42dd9d9847d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20e11c7-2d29-4908-aecf-b42dd9d9847d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97657a73-d91a-4f51-ab9c-fe84e2fad45e', 'volume_name': 'volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e', 'volume_size': 2}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77fa9e0-96f3-4449-8825-36ebb95ac9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77fa9e0-96f3-4449-8825-36ebb95ac9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52b375d-f75d-4e12-a7d8-68b9ec649ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:30 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Volume 97657a73-d91a-4f51-ab9c-fe84e2fad45e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e', 'volume_size': 2}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1237056792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97657a73-d91a-4f51-ab9c-fe84e2fad45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ba51f3f0224e01b05adcd8b246fd95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:30Z,use_quota=True,user_id='e4717556ae7f43f181533abda2ce80ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Creating volume 97657a73-d91a-4f51-ab9c-fe84e2fad45e {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:18:30 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e 2147483648 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:30 devstack sudo[85013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e 2147483648
Apr 28 02:18:30 devstack sudo[85013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:30 devstack sudo[84999]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1f3f53c1-78f2-441b-bcff-07c8bbee5762" returned: 0 in 0.594s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Lock "cinder-quobyte-1f3f53c1-78f2-441b-bcff-07c8bbee5762" released by "delete_volume" :: held 1.443s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Created reservations ['0333539e-4442-4354-b6fd-ef288b747e2c', '7d6e1de1-4c7c-4687-99f2-a3da34ce9582', 'aeee3765-6fbf-4018-addd-07a88b5637e7', '54424e5a-8b76-4f02-b68a-75a34c7e1777'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:30 devstack sudo[85016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:18:30 devstack sudo[85016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:31 devstack sudo[85013]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e 2147483648" returned: 0 in 0.733s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:31 devstack sudo[85021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e
Apr 28 02:18:31 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Acquiring lock "cinder-ea548195-8c93-4898-893e-86aa4b4b6360-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:31 devstack sudo[85016]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.650s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:18:31 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Deleted volume successfully.
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Lock "cinder-ea548195-8c93-4898-893e-86aa4b4b6360-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c987b6d4-276f-4888-8435-d9e02638c3f6 tempest-ServersNegativeTestJSON-354499670 None] Lock "cinder-1f3f53c1-78f2-441b-bcff-07c8bbee5762-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Acquiring lock "cinder-quobyte-ea548195-8c93-4898-893e-86aa4b4b6360" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Lock "cinder-quobyte-ea548195-8c93-4898-893e-86aa4b4b6360" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ae78c8-0a0a-4653-8a58-2da911f4ff60]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ea548195-8c93-4898-893e-86aa4b4b6360 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:31 devstack sudo[85026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ea548195-8c93-4898-893e-86aa4b4b6360
Apr 28 02:18:31 devstack sudo[85026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:31 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e" returned: 0 in 0.613s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52b375d-f75d-4e12-a7d8-68b9ec649ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e', 'volume_size': 2}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c742489-622d-4fe7-8476-159bb766f2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:31 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Volume volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e (97657a73-d91a-4f51-ab9c-fe84e2fad45e): created successfully
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c742489-622d-4fe7-8476-159bb766f2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Flow 'volume_create_manager' (81b31b9d-8b4d-40ba-a022-ee8aeb44a0fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:31 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-647cb3c5-5586-47d8-a36e-7e798c4560eb tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Created volume successfully.
Apr 28 02:18:32 devstack sudo[85026]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ea548195-8c93-4898-893e-86aa4b4b6360" returned: 0 in 0.640s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ea548195-8c93-4898-893e-86aa4b4b6360 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:32 devstack sudo[85033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ea548195-8c93-4898-893e-86aa4b4b6360
Apr 28 02:18:32 devstack sudo[85033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:32 devstack sudo[85033]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ea548195-8c93-4898-893e-86aa4b4b6360" returned: 0 in 0.558s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Lock "cinder-quobyte-ea548195-8c93-4898-893e-86aa4b4b6360" released by "delete_volume" :: held 1.238s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Creating offline snapshot b034857d-49a9-4902-bc0a-f41bd17411ae of volume 97657a73-d91a-4f51-ab9c-fe84e2fad45e {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:18:32 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2bda64-ad53-4d55-beca-2bb65743c23c]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:18:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:33 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Created reservations ['0baf8ffa-4faf-492f-b736-e342254451c9', 'e096b4d9-146f-41cc-9cab-5dbe681f161c', '029513ef-30ac-4c96-8f1a-fe56a4d26ff4', '0c079b40-c5f6-4919-960c-c6eae26401cc'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:18:33 devstack sudo[85036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e
Apr 28 02:18:33 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:33 devstack sudo[85038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:18:33 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:33 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e" returned: 0 in 0.779s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae 2G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:33 devstack sudo[85048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae 2G
Apr 28 02:18:33 devstack sudo[85048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:33 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.707s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:33 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:18:33 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Deleted volume successfully.
Apr 28 02:18:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-046cff71-78b3-4756-86fc-de119799b033 tempest-ServersNegativeTestJSON-354499670 None] Lock "cinder-ea548195-8c93-4898-893e-86aa4b4b6360-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:34 devstack sudo[85048]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae 2G" returned: 0 in 0.745s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:34 devstack sudo[85055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae
Apr 28 02:18:34 devstack sudo[85055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:35 devstack sudo[85055]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae" returned: 0 in 0.566s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:35 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae is being set with open permissions: ugo+rw
Apr 28 02:18:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:35 devstack sudo[85061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae
Apr 28 02:18:35 devstack sudo[85061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:35 devstack sudo[85061]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae" returned: 0 in 0.797s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:35 devstack sudo[85104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.info
Apr 28 02:18:35 devstack sudo[85104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:36 devstack sudo[85104]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.info" returned: 0 in 0.558s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:36 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.info is being set with open permissions: ugo+rw
Apr 28 02:18:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:36 devstack sudo[85114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.info
Apr 28 02:18:36 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:37 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.info" returned: 0 in 0.695s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.306s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:37 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:UPDATE=118,cinder:DELETE=7,cinder:SELECT=93,cinder:INSERT=30 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:18:37 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=75,cinder:DELETE=14,cinder:UPDATE=115,cinder:INSERT=25 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:18:37 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-1193afea-eb51-4882-838d-04dea207368b tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Create snapshot completed successfully
Apr 28 02:18:38 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Acquiring lock "cinder-b034857d-49a9-4902-bc0a-f41bd17411ae-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:38 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "cinder-b034857d-49a9-4902-bc0a-f41bd17411ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.103s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:38 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Acquiring lock "cinder-quobyte-97657a73-d91a-4f51-ab9c-fe84e2fad45e" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:38 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "cinder-quobyte-97657a73-d91a-4f51-ab9c-fe84e2fad45e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:38 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Acquiring lock "cinder-quobyte-b034857d-49a9-4902-bc0a-f41bd17411ae" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:38 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "cinder-quobyte-b034857d-49a9-4902-bc0a-f41bd17411ae" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Deleting offline snapshot b034857d-49a9-4902-bc0a-f41bd17411ae of volume 97657a73-d91a-4f51-ab9c-fe84e2fad45e {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:18:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] snapshot_file for this snap is: volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:18:38 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e54474f-d299-4d61-8571-83bea9ac7a6d]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:18:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:38 devstack sudo[85162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae
Apr 28 02:18:38 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:39 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae" returned: 0 in 0.846s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:18:39 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e0e74a-81e9-454b-aa84-de06a0718d05]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:18:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:39 devstack sudo[85167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e
Apr 28 02:18:39 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:40 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e" returned: 0 in 0.700s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:40 devstack sudo[85173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae
Apr 28 02:18:40 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:40 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2cc29442-2c61-4e5f-9c99-01314cb7ef01 tempest-VolumesActionsTest-1998942808 None] Acquiring lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2" by "attach_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:40 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2cc29442-2c61-4e5f-9c99-01314cb7ef01 tempest-VolumesActionsTest-1998942808 None] Lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2" acquired by "attach_volume" :: waited 0.039s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:40 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2cc29442-2c61-4e5f-9c99-01314cb7ef01 tempest-VolumesActionsTest-1998942808 None] Attaching volume 776d4fe0-3bff-4403-9889-b8229813ffe2 to instance b4ddea63-c60b-4a2d-8581-d2ced24f85f9 at mountpoint /dev/vdb on host None.
Apr 28 02:18:40 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2cc29442-2c61-4e5f-9c99-01314cb7ef01 tempest-VolumesActionsTest-1998942808 None] Attach volume completed successfully.
Apr 28 02:18:40 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2cc29442-2c61-4e5f-9c99-01314cb7ef01 tempest-VolumesActionsTest-1998942808 None] Lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2" released by "attach_volume" :: held 0.175s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:40 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae" returned: 0 in 0.682s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:40 devstack sudo[85178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae
Apr 28 02:18:40 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-88f6495c-895b-4082-8318-e6fafef3b403 tempest-VolumesActionsTest-1998942808 None] Acquiring lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2-detach_volume" by "detach_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-88f6495c-895b-4082-8318-e6fafef3b403 tempest-VolumesActionsTest-1998942808 None] Lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:41 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-88f6495c-895b-4082-8318-e6fafef3b403 tempest-VolumesActionsTest-1998942808 None] Detaching volume 776d4fe0-3bff-4403-9889-b8229813ffe2 from instance b4ddea63-c60b-4a2d-8581-d2ced24f85f9.
Apr 28 02:18:41 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-88f6495c-895b-4082-8318-e6fafef3b403 tempest-VolumesActionsTest-1998942808 None] Detach volume completed successfully.
Apr 28 02:18:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-88f6495c-895b-4082-8318-e6fafef3b403 tempest-VolumesActionsTest-1998942808 None] Lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:41 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e.b034857d-49a9-4902-bc0a-f41bd17411ae" returned: 0 in 0.661s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "cinder-quobyte-b034857d-49a9-4902-bc0a-f41bd17411ae" released by "_delete_snapshot" :: held 3.113s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "cinder-quobyte-97657a73-d91a-4f51-ab9c-fe84e2fad45e" released by "delete_snapshot" :: held 3.163s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:41 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Created reservations ['9bd202e1-5686-437d-a360-baba0040d591', '46e23ac0-d1b4-41b5-8098-64f5d7707436', '8eed5eca-2943-4f98-a9e7-a98c1f8d6ffa', '7c605a4a-4465-4c3d-8ae7-35697485f8aa'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:18:41 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Delete snapshot completed successfully.
Apr 28 02:18:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e6891f9-c622-4ce0-a779-4db8b2eabf21 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "cinder-b034857d-49a9-4902-bc0a-f41bd17411ae-delete_snapshot" released by "delete_snapshot" :: held 3.343s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Acquiring lock "cinder-97657a73-d91a-4f51-ab9c-fe84e2fad45e-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "cinder-97657a73-d91a-4f51-ab9c-fe84e2fad45e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Acquiring lock "cinder-quobyte-97657a73-d91a-4f51-ab9c-fe84e2fad45e" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "cinder-quobyte-97657a73-d91a-4f51-ab9c-fe84e2fad45e" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:42 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f055c0-3421-44e9-bbf0-dfe2cde2d7ed]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:18:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:43 devstack sudo[85190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e
Apr 28 02:18:43 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:43 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e" returned: 0 in 0.879s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:43 devstack sudo[85216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e
Apr 28 02:18:43 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:44 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-97657a73-d91a-4f51-ab9c-fe84e2fad45e" returned: 0 in 0.556s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "cinder-quobyte-97657a73-d91a-4f51-ab9c-fe84e2fad45e" released by "delete_volume" :: held 1.535s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:44 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Created reservations ['64e015b0-75f5-40d0-9e10-6f113cb257dd', '3acb65af-a80e-4e4a-bb6d-e7c13bb540e9', '38d507f5-e74d-42d3-9dc2-4fa66257d853', 'bf8ac2af-9a42-46e0-b352-68ff8da659f9'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:18:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:44 devstack sudo[85222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:18:44 devstack sudo[85222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:45 devstack sudo[85222]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.563s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:45 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:18:45 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Deleted volume successfully.
Apr 28 02:18:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f0d01a48-6d27-4fda-9662-5521ba353ee3 tempest-VolumesSnapshotNegativeTestJSON-467348505 None] Lock "cinder-97657a73-d91a-4f51-ab9c-fe84e2fad45e-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Flow 'volume_create_manager' (9a7d9854-7594-4996-92da-e7ff5a79a671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2577fe47-d0ba-4dba-a142-0043aa1bb38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2577fe47-d0ba-4dba-a142-0043aa1bb38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1372228124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1c3342-f2e1-48e1-aa75-897a3571f27a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5936e2f1c22a4ed5bbdd3d23e4ed9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:52Z,use_quota=True,user_id='49768f271a08448f835024af1880b897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0b9ccd-2a76-4636-a11e-5702a52dc317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0b9ccd-2a76-4636-a11e-5702a52dc317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92de692c-bdf3-4e56-a343-6b26f713c7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92de692c-bdf3-4e56-a343-6b26f713c7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd1c3342-f2e1-48e1-aa75-897a3571f27a', 'volume_name': 'volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4bee8c-50a6-4995-b731-9a0dd45259fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad4bee8c-50a6-4995-b731-9a0dd45259fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4f3d6e-ef06-4603-ad23-e9202dc5e7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:51 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume fd1c3342-f2e1-48e1-aa75-897a3571f27a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a', 'volume_size': 1}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1372228124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1c3342-f2e1-48e1-aa75-897a3571f27a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5936e2f1c22a4ed5bbdd3d23e4ed9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:52Z,use_quota=True,user_id='49768f271a08448f835024af1880b897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Creating volume fd1c3342-f2e1-48e1-aa75-897a3571f27a {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:18:52 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:18:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:52 devstack sudo[85272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a 1073741824
Apr 28 02:18:52 devstack sudo[85272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:18:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:52 devstack sudo[85278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:18:52 devstack sudo[85278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:52 devstack sudo[85272]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a 1073741824" returned: 0 in 0.805s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:52 devstack sudo[85280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a
Apr 28 02:18:52 devstack sudo[85280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:53 devstack sudo[85278]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.687s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:18:53 devstack sudo[85280]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a" returned: 0 in 0.603s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:18:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:53 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4f3d6e-ef06-4603-ad23-e9202dc5e7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:53 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49df15bd-b298-41b5-8626-39e5974c3dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:53 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a (fd1c3342-f2e1-48e1-aa75-897a3571f27a): created successfully
Apr 28 02:18:53 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49df15bd-b298-41b5-8626-39e5974c3dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:53 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Flow 'volume_create_manager' (9a7d9854-7594-4996-92da-e7ff5a79a671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:53 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-7762dcab-4965-4c27-bab1-2f807492481f tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Created volume successfully.
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Flow 'volume_create_manager' (b9709ac4-92ea-43d0-917a-91a19054c29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24801ba-4677-41c7-9a8a-fe80bb6ea75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24801ba-4677-41c7-9a8a-fe80bb6ea75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-491537795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929ff7e4-2aea-4a29-9799-397519b6230f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5936e2f1c22a4ed5bbdd3d23e4ed9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:55Z,use_quota=True,user_id='49768f271a08448f835024af1880b897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb63491-8f36-46a3-a70d-7946e0c66055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb63491-8f36-46a3-a70d-7946e0c66055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce547899-4ea9-403f-ad63-91b7835a85df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce547899-4ea9-403f-ad63-91b7835a85df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '929ff7e4-2aea-4a29-9799-397519b6230f', 'volume_name': 'volume-929ff7e4-2aea-4a29-9799-397519b6230f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622a7366-833d-494a-bd00-ec28ef980501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (622a7366-833d-494a-bd00-ec28ef980501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b96cdc1-bf18-49dc-b075-140f51c0cd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:54 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume 929ff7e4-2aea-4a29-9799-397519b6230f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-929ff7e4-2aea-4a29-9799-397519b6230f', 'volume_size': 1}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-491537795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929ff7e4-2aea-4a29-9799-397519b6230f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5936e2f1c22a4ed5bbdd3d23e4ed9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:55Z,use_quota=True,user_id='49768f271a08448f835024af1880b897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Creating volume 929ff7e4-2aea-4a29-9799-397519b6230f {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:18:54 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:18:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-929ff7e4-2aea-4a29-9799-397519b6230f 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:54 devstack sudo[85289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-929ff7e4-2aea-4a29-9799-397519b6230f 1073741824
Apr 28 02:18:54 devstack sudo[85289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Flow 'volume_create_manager' (52b1b8df-9dba-4a53-af11-9ffc2e3f4717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219932c2-4e93-41f6-abf3-de2de2996a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219932c2-4e93-41f6-abf3-de2de2996a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2003667919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfff3716-f36d-4f56-a97c-7c365a360dc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb8eaab3a67543b0b32b0f812040f406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:55Z,use_quota=True,user_id='eaedaca140ad4b35baf67332afaf4c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f196a798-6a54-462b-aeb2-e4673781f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f196a798-6a54-462b-aeb2-e4673781f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a3b166-622b-4ea0-b6ac-e70dab0d3ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a3b166-622b-4ea0-b6ac-e70dab0d3ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfff3716-f36d-4f56-a97c-7c365a360dc1', 'volume_name': 'volume-dfff3716-f36d-4f56-a97c-7c365a360dc1', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e62ec0c-70fe-4bf4-b667-234c4f5d2f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e62ec0c-70fe-4bf4-b667-234c4f5d2f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d0a3b0-8672-48dd-ac73-bff490453d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Volume dfff3716-f36d-4f56-a97c-7c365a360dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfff3716-f36d-4f56-a97c-7c365a360dc1', 'volume_size': 1}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Flow 'volume_create_manager' (0c2edc9f-d5f6-49e6-a800-aaca7d25e7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faffea52-f1e4-45d6-9b2a-f4423a335207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faffea52-f1e4-45d6-9b2a-f4423a335207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-187352440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aff1e08-04dd-4538-80a3-dec1cb85724d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5936e2f1c22a4ed5bbdd3d23e4ed9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:55Z,use_quota=True,user_id='49768f271a08448f835024af1880b897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad91a5b-512f-48a7-b239-716d197efd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad91a5b-512f-48a7-b239-716d197efd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446c91b6-b0e0-48e8-b466-4de17f46ff7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446c91b6-b0e0-48e8-b466-4de17f46ff7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aff1e08-04dd-4538-80a3-dec1cb85724d', 'volume_name': 'volume-7aff1e08-04dd-4538-80a3-dec1cb85724d', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e690ac2-6ad4-41fa-879a-8725b70d550a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e690ac2-6ad4-41fa-879a-8725b70d550a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c610153e-887c-467d-84dc-fb0f193eaed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume 7aff1e08-04dd-4538-80a3-dec1cb85724d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aff1e08-04dd-4538-80a3-dec1cb85724d', 'volume_size': 1}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Flow 'volume_create_manager' (2c868191-e92a-44e2-a368-bcd61315aff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f2ee5b-4d9a-454b-89b7-fe1853bc9095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f2ee5b-4d9a-454b-89b7-fe1853bc9095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417531620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd3e20a-f2bf-4364-acc7-6d49ebda0795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5936e2f1c22a4ed5bbdd3d23e4ed9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:55Z,use_quota=True,user_id='49768f271a08448f835024af1880b897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6ac4c6-4960-424e-9d3d-eba53ceed91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6ac4c6-4960-424e-9d3d-eba53ceed91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8f4308-626f-43ea-9d25-290d0379fbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8f4308-626f-43ea-9d25-290d0379fbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd3e20a-f2bf-4364-acc7-6d49ebda0795', 'volume_name': 'volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ab2ce6-46d9-4345-a8c8-af50c289215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ab2ce6-46d9-4345-a8c8-af50c289215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd738f5f-b296-4587-97cc-14b9bf850bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume fcd3e20a-f2bf-4364-acc7-6d49ebda0795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795', 'volume_size': 1}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Flow 'volume_create_manager' (6e8761e9-849c-45cc-b2cf-5c86d54de76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38e53c6-a27f-428b-a68e-3705c46a0d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38e53c6-a27f-428b-a68e-3705c46a0d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2097325746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3528bc0-8a39-4ef1-baa8-ddd0c538477a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5936e2f1c22a4ed5bbdd3d23e4ed9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:56Z,use_quota=True,user_id='49768f271a08448f835024af1880b897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bd0aac-7eed-411a-91b2-4191429eac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47bd0aac-7eed-411a-91b2-4191429eac61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dded81b-43ca-44ae-ac3f-c0f6cd2b5ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dded81b-43ca-44ae-ac3f-c0f6cd2b5ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3528bc0-8a39-4ef1-baa8-ddd0c538477a', 'volume_name': 'volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403c0a5a-1649-42d1-b3f4-fadb28585cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403c0a5a-1649-42d1-b3f4-fadb28585cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2a9b40-02be-4c27-bdeb-d2e6384cb540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:56 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume b3528bc0-8a39-4ef1-baa8-ddd0c538477a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a', 'volume_size': 1}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:56 devstack sudo[85289]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-929ff7e4-2aea-4a29-9799-397519b6230f 1073741824" returned: 0 in 1.102s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-929ff7e4-2aea-4a29-9799-397519b6230f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:56 devstack sudo[85294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-929ff7e4-2aea-4a29-9799-397519b6230f
Apr 28 02:18:56 devstack sudo[85294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Flow 'volume_create_manager' (14b3f70f-6a26-47a3-870c-048233efe131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7e615a-83f7-46f4-b698-d2c1bedc3204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7e615a-83f7-46f4-b698-d2c1bedc3204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2025282757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320a43bc-db47-4f59-a105-ba2d7ba34578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5936e2f1c22a4ed5bbdd3d23e4ed9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:56Z,use_quota=True,user_id='49768f271a08448f835024af1880b897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769bcd37-5ed6-4ce2-b374-d5f30d71ddae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769bcd37-5ed6-4ce2-b374-d5f30d71ddae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8301c7ee-c05a-427c-add8-ab43b64c2bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8301c7ee-c05a-427c-add8-ab43b64c2bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320a43bc-db47-4f59-a105-ba2d7ba34578', 'volume_name': 'volume-320a43bc-db47-4f59-a105-ba2d7ba34578', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e2137c-8c37-4456-87ce-548c1c81bea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e2137c-8c37-4456-87ce-548c1c81bea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c9f834-7c15-45fa-9165-0bc154ff6cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:56 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume 320a43bc-db47-4f59-a105-ba2d7ba34578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320a43bc-db47-4f59-a105-ba2d7ba34578', 'volume_size': 1}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:56 devstack sudo[85294]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-929ff7e4-2aea-4a29-9799-397519b6230f" returned: 0 in 0.599s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2003667919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfff3716-f36d-4f56-a97c-7c365a360dc1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb8eaab3a67543b0b32b0f812040f406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:55Z,use_quota=True,user_id='eaedaca140ad4b35baf67332afaf4c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Creating volume dfff3716-f36d-4f56-a97c-7c365a360dc1 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:18:56 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-dfff3716-f36d-4f56-a97c-7c365a360dc1 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b96cdc1-bf18-49dc-b075-140f51c0cd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929ff7e4-2aea-4a29-9799-397519b6230f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27561aa9-df50-4563-8e99-8655f3cbde71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:56 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume volume-929ff7e4-2aea-4a29-9799-397519b6230f (929ff7e4-2aea-4a29-9799-397519b6230f): created successfully
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27561aa9-df50-4563-8e99-8655f3cbde71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Flow 'volume_create_manager' (b9709ac4-92ea-43d0-917a-91a19054c29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:56 devstack sudo[85297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-dfff3716-f36d-4f56-a97c-7c365a360dc1 1073741824
Apr 28 02:18:56 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-0cf26fd8-7d84-49bb-8d01-319276b90247 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Created volume successfully.
Apr 28 02:18:56 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:57 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-dfff3716-f36d-4f56-a97c-7c365a360dc1 1073741824" returned: 0 in 0.796s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-dfff3716-f36d-4f56-a97c-7c365a360dc1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:57 devstack sudo[85319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-dfff3716-f36d-4f56-a97c-7c365a360dc1
Apr 28 02:18:57 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:58 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-dfff3716-f36d-4f56-a97c-7c365a360dc1" returned: 0 in 0.530s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.816s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-187352440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aff1e08-04dd-4538-80a3-dec1cb85724d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5936e2f1c22a4ed5bbdd3d23e4ed9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:55Z,use_quota=True,user_id='49768f271a08448f835024af1880b897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Creating volume 7aff1e08-04dd-4538-80a3-dec1cb85724d {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:18:58 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7aff1e08-04dd-4538-80a3-dec1cb85724d 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d0a3b0-8672-48dd-ac73-bff490453d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfff3716-f36d-4f56-a97c-7c365a360dc1', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:58 devstack sudo[85322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7aff1e08-04dd-4538-80a3-dec1cb85724d 1073741824
Apr 28 02:18:58 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaa1c869-8343-4fbb-8cdd-c72793d61395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:58 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Volume volume-dfff3716-f36d-4f56-a97c-7c365a360dc1 (dfff3716-f36d-4f56-a97c-7c365a360dc1): created successfully
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaa1c869-8343-4fbb-8cdd-c72793d61395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Flow 'volume_create_manager' (52b1b8df-9dba-4a53-af11-9ffc2e3f4717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:58 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-41fdd37a-c2db-4561-92f4-b6dd4d898f7b req-e2fcbf84-5e13-4cf1-81d2-b04a26ee70fe tempest-VolumesGetTestJSON-725381137 None] Created volume successfully.
Apr 28 02:18:58 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7aff1e08-04dd-4538-80a3-dec1cb85724d 1073741824" returned: 0 in 0.803s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7aff1e08-04dd-4538-80a3-dec1cb85724d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:58 devstack sudo[85327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7aff1e08-04dd-4538-80a3-dec1cb85724d
Apr 28 02:18:58 devstack sudo[85327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Acquiring lock "cinder-dfff3716-f36d-4f56-a97c-7c365a360dc1-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Lock "cinder-dfff3716-f36d-4f56-a97c-7c365a360dc1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:59 devstack sudo[85327]: pam_unix(sudo:session): session closed for user root
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7aff1e08-04dd-4538-80a3-dec1cb85724d" returned: 0 in 0.674s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.186s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417531620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd3e20a-f2bf-4364-acc7-6d49ebda0795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5936e2f1c22a4ed5bbdd3d23e4ed9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:55Z,use_quota=True,user_id='49768f271a08448f835024af1880b897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Creating volume fcd3e20a-f2bf-4364-acc7-6d49ebda0795 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:18:59 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c610153e-887c-467d-84dc-fb0f193eaed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aff1e08-04dd-4538-80a3-dec1cb85724d', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:59 devstack sudo[85341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795 1073741824
Apr 28 02:18:59 devstack sudo[85341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee557c8-b6b0-43d4-a365-1dfa20073265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Acquiring lock "cinder-quobyte-dfff3716-f36d-4f56-a97c-7c365a360dc1" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:18:59 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume volume-7aff1e08-04dd-4538-80a3-dec1cb85724d (7aff1e08-04dd-4538-80a3-dec1cb85724d): created successfully
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee557c8-b6b0-43d4-a365-1dfa20073265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Flow 'volume_create_manager' (0c2edc9f-d5f6-49e6-a800-aaca7d25e7d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Lock "cinder-quobyte-dfff3716-f36d-4f56-a97c-7c365a360dc1" acquired by "delete_volume" :: waited 0.050s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:18:59 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f6a573ae-d45d-4c78-9e5c-feecbb200278 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Created volume successfully.
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02d0386-eb93-4eb9-8191-50d7323d9640]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:18:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-dfff3716-f36d-4f56-a97c-7c365a360dc1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:18:59 devstack sudo[85346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-dfff3716-f36d-4f56-a97c-7c365a360dc1
Apr 28 02:18:59 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:00 devstack sudo[85341]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795 1073741824" returned: 0 in 1.001s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:00 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-dfff3716-f36d-4f56-a97c-7c365a360dc1" returned: 0 in 0.933s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-dfff3716-f36d-4f56-a97c-7c365a360dc1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:00 devstack sudo[85357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795
Apr 28 02:19:00 devstack sudo[85357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:00 devstack sudo[85359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-dfff3716-f36d-4f56-a97c-7c365a360dc1
Apr 28 02:19:00 devstack sudo[85359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:01 devstack sudo[85357]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795" returned: 0 in 0.599s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:01 devstack sudo[85359]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.283s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2097325746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3528bc0-8a39-4ef1-baa8-ddd0c538477a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5936e2f1c22a4ed5bbdd3d23e4ed9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:56Z,use_quota=True,user_id='49768f271a08448f835024af1880b897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Creating volume b3528bc0-8a39-4ef1-baa8-ddd0c538477a {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:19:01 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-dfff3716-f36d-4f56-a97c-7c365a360dc1" returned: 0 in 0.595s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:01 devstack sudo[85367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a 1073741824
Apr 28 02:19:01 devstack sudo[85367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd738f5f-b296-4587-97cc-14b9bf850bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a5c8c9-4deb-4157-9368-fa7669adfa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Lock "cinder-quobyte-dfff3716-f36d-4f56-a97c-7c365a360dc1" released by "delete_volume" :: held 1.593s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:01 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795 (fcd3e20a-f2bf-4364-acc7-6d49ebda0795): created successfully
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a5c8c9-4deb-4157-9368-fa7669adfa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Flow 'volume_create_manager' (2c868191-e92a-44e2-a368-bcd61315aff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:19:01 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-bcc42466-ffdc-4fd8-9897-a0c786f28604 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Created volume successfully.
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.quota [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Created reservations ['8f3bd99b-ae9b-428c-be07-0c77bbb6a7d9', '6b67fce2-58ce-4259-92be-974e8849776d', 'f5db8c01-5cda-4d51-ae20-625158c4b786', '8f74cf7d-f8f1-4035-b892-7d7566d96fa0'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:01 devstack sudo[85370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:19:01 devstack sudo[85370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:02 devstack sudo[85367]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a 1073741824" returned: 0 in 1.027s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:02 devstack sudo[85370]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.732s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG cinder.manager [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:19:02 devstack cinder-volume[81489]: INFO cinder.volume.manager [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Deleted volume successfully.
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [req-bb0a0b64-034c-4b24-8e8b-5c4b569c4902 req-3b05d820-0dde-4790-96e6-f4787605f97b tempest-VolumesGetTestJSON-725381137 None] Lock "cinder-dfff3716-f36d-4f56-a97c-7c365a360dc1-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:02 devstack sudo[85391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a
Apr 28 02:19:02 devstack sudo[85391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:02 devstack sudo[85391]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a" returned: 0 in 0.496s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.595s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2025282757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320a43bc-db47-4f59-a105-ba2d7ba34578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5936e2f1c22a4ed5bbdd3d23e4ed9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:18:56Z,use_quota=True,user_id='49768f271a08448f835024af1880b897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Creating volume 320a43bc-db47-4f59-a105-ba2d7ba34578 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:19:02 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-320a43bc-db47-4f59-a105-ba2d7ba34578 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2a9b40-02be-4c27-bdeb-d2e6384cb540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2caba5-9ddd-4403-ab3b-5aa3ab7133f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:02 devstack sudo[85397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-320a43bc-db47-4f59-a105-ba2d7ba34578 1073741824
Apr 28 02:19:02 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:02 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a (b3528bc0-8a39-4ef1-baa8-ddd0c538477a): created successfully
Apr 28 02:19:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2caba5-9ddd-4403-ab3b-5aa3ab7133f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Flow 'volume_create_manager' (6e8761e9-849c-45cc-b2cf-5c86d54de76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:19:03 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-fd29819c-79ed-4ec8-b973-0ebfaf2fe997 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Created volume successfully.
Apr 28 02:19:03 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-320a43bc-db47-4f59-a105-ba2d7ba34578 1073741824" returned: 0 in 0.789s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-320a43bc-db47-4f59-a105-ba2d7ba34578 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:03 devstack sudo[85413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-320a43bc-db47-4f59-a105-ba2d7ba34578
Apr 28 02:19:03 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:04 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-320a43bc-db47-4f59-a105-ba2d7ba34578" returned: 0 in 0.677s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:19:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c9f834-7c15-45fa-9165-0bc154ff6cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320a43bc-db47-4f59-a105-ba2d7ba34578', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146d39bf-928c-4316-b4d7-9f35a147cb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:04 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Volume volume-320a43bc-db47-4f59-a105-ba2d7ba34578 (320a43bc-db47-4f59-a105-ba2d7ba34578): created successfully
Apr 28 02:19:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146d39bf-928c-4316-b4d7-9f35a147cb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Flow 'volume_create_manager' (14b3f70f-6a26-47a3-870c-048233efe131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:19:04 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-e9ee6dd7-1aba-4ff8-9b07-13c9e300f0b0 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Created volume successfully.
Apr 28 02:19:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "cinder-320a43bc-db47-4f59-a105-ba2d7ba34578-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-320a43bc-db47-4f59-a105-ba2d7ba34578-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "cinder-quobyte-320a43bc-db47-4f59-a105-ba2d7ba34578" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-quobyte-320a43bc-db47-4f59-a105-ba2d7ba34578" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:05 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8113c8-cca6-4c65-8160-8f5334914b03]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-320a43bc-db47-4f59-a105-ba2d7ba34578 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:05 devstack sudo[85448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-320a43bc-db47-4f59-a105-ba2d7ba34578
Apr 28 02:19:05 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:06 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-320a43bc-db47-4f59-a105-ba2d7ba34578" returned: 0 in 0.812s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-320a43bc-db47-4f59-a105-ba2d7ba34578 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:06 devstack sudo[85463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-320a43bc-db47-4f59-a105-ba2d7ba34578
Apr 28 02:19:06 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Flow 'volume_create_manager' (459eb7a0-f1ef-414a-8543-97a6c586d7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e67145-0c8d-4e18-b329-8e328274e400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85e67145-0c8d-4e18-b329-8e328274e400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1540886864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeeba5af-f57c-42b7-88be-38fac13667ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ae6f8c3b081448a6a1ba911c9c506adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:19:07Z,use_quota=True,user_id='c69bc7e86b0e49ed9a3b5b134e4d6d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4545c0-f6ad-4028-9918-d90a5516f76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4545c0-f6ad-4028-9918-d90a5516f76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750ef9d0-89f7-4f5d-a8b8-69982827e6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750ef9d0-89f7-4f5d-a8b8-69982827e6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeeba5af-f57c-42b7-88be-38fac13667ab', 'volume_name': 'volume-eeeba5af-f57c-42b7-88be-38fac13667ab', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68783fd-30d7-45cd-aea0-2df90f17eb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68783fd-30d7-45cd-aea0-2df90f17eb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb3fe8a-a3ca-4e2d-9271-0cf6f91fb928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:06 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Volume eeeba5af-f57c-42b7-88be-38fac13667ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeeba5af-f57c-42b7-88be-38fac13667ab', 'volume_size': 1}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1540886864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeeba5af-f57c-42b7-88be-38fac13667ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ae6f8c3b081448a6a1ba911c9c506adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:19:07Z,use_quota=True,user_id='c69bc7e86b0e49ed9a3b5b134e4d6d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Creating volume eeeba5af-f57c-42b7-88be-38fac13667ab {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:19:06 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:19:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-eeeba5af-f57c-42b7-88be-38fac13667ab 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:07 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-320a43bc-db47-4f59-a105-ba2d7ba34578" returned: 0 in 0.754s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:07 devstack sudo[85467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-eeeba5af-f57c-42b7-88be-38fac13667ab 1073741824
Apr 28 02:19:07 devstack sudo[85467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:07 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-quobyte-320a43bc-db47-4f59-a105-ba2d7ba34578" released by "delete_volume" :: held 1.635s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:07 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Created reservations ['f8939391-3a72-4ce9-b4de-340d545c9906', 'b1d071a0-743e-4888-8341-953d84f8e09f', '8c488706-2cbd-4794-89c5-fbc2579f598f', '130fdb84-3d98-47e7-acbb-14d7a82faacd'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:19:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:07 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:07 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:07 devstack sudo[85469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:19:07 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:07 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "cinder-b3528bc0-8a39-4ef1-baa8-ddd0c538477a-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:07 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-b3528bc0-8a39-4ef1-baa8-ddd0c538477a-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:07 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.824s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:07 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:19:07 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Deleted volume successfully.
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7843ab42-229d-4b79-a1f6-ebacca0a0bb1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-320a43bc-db47-4f59-a105-ba2d7ba34578-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "cinder-quobyte-b3528bc0-8a39-4ef1-baa8-ddd0c538477a" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-quobyte-b3528bc0-8a39-4ef1-baa8-ddd0c538477a" acquired by "delete_volume" :: waited 0.028s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:08 devstack sudo[85467]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-eeeba5af-f57c-42b7-88be-38fac13667ab 1073741824" returned: 0 in 1.089s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[909c4014-d947-48f7-bed2-94e599ae7010]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-eeeba5af-f57c-42b7-88be-38fac13667ab {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:08 devstack sudo[85485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-eeeba5af-f57c-42b7-88be-38fac13667ab
Apr 28 02:19:08 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:08 devstack sudo[85484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a
Apr 28 02:19:08 devstack sudo[85484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:08 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-eeeba5af-f57c-42b7-88be-38fac13667ab" returned: 0 in 0.484s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb3fe8a-a3ca-4e2d-9271-0cf6f91fb928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeeba5af-f57c-42b7-88be-38fac13667ab', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63df23be-c688-42b8-bbc3-59f907d4f7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:08 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Volume volume-eeeba5af-f57c-42b7-88be-38fac13667ab (eeeba5af-f57c-42b7-88be-38fac13667ab): created successfully
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63df23be-c688-42b8-bbc3-59f907d4f7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Flow 'volume_create_manager' (459eb7a0-f1ef-414a-8543-97a6c586d7bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:19:08 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-1fe0f9a9-7c28-4999-815a-5d8182e74cdf tempest-VolumesTestJSON-915509355 None] Created volume successfully.
Apr 28 02:19:08 devstack sudo[85484]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a" returned: 0 in 0.679s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:08 devstack sudo[85500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a
Apr 28 02:19:08 devstack sudo[85500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:09 devstack sudo[85500]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b3528bc0-8a39-4ef1-baa8-ddd0c538477a" returned: 0 in 0.482s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:09 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-quobyte-b3528bc0-8a39-4ef1-baa8-ddd0c538477a" released by "delete_volume" :: held 1.224s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:09 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Created reservations ['7a34976e-b4a8-4caa-902c-37e020238b13', '8e79a8bc-d294-4a15-8040-c71ef27ac2fd', '0290ca00-2085-4efa-acaa-a5f776386bc6', '383a9ef2-cf1c-4a19-ad17-214c7491af89'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:19:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:09 devstack sudo[85511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:19:09 devstack sudo[85511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Flow 'volume_create_manager' (38790ad4-9752-4725-9469-ee895c5cc15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414b0903-c60f-4b41-b424-cd8687e34c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414b0903-c60f-4b41-b424-cd8687e34c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1961061175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b48cc60-b85b-4611-b4c9-ea0f4247482f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ae6f8c3b081448a6a1ba911c9c506adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:19:10Z,use_quota=True,user_id='c69bc7e86b0e49ed9a3b5b134e4d6d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9be0b76-8a6f-4b15-897b-6579d21c4ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9be0b76-8a6f-4b15-897b-6579d21c4ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b65d69-a8a5-4b46-b04f-bfe767dfdea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b65d69-a8a5-4b46-b04f-bfe767dfdea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b48cc60-b85b-4611-b4c9-ea0f4247482f', 'volume_name': 'volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881989e9-729d-416e-ac77-634d28a1178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (881989e9-729d-416e-ac77-634d28a1178e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca530c1-5b6d-4223-b781-b4a28f6e300a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:10 devstack sudo[85511]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:10 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Volume 8b48cc60-b85b-4611-b4c9-ea0f4247482f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f', 'volume_size': 1}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1961061175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b48cc60-b85b-4611-b4c9-ea0f4247482f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ae6f8c3b081448a6a1ba911c9c506adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:19:10Z,use_quota=True,user_id='c69bc7e86b0e49ed9a3b5b134e4d6d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Creating volume 8b48cc60-b85b-4611-b4c9-ea0f4247482f {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:19:10 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "cinder-fcd3e20a-f2bf-4364-acc7-6d49ebda0795-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.140s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:10 devstack sudo[85548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f 1073741824
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:19:10 devstack sudo[85548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:10 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Deleted volume successfully.
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-fcd3e20a-f2bf-4364-acc7-6d49ebda0795-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-22f60de9-2849-45d7-8268-dd72c04d8ce1 tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-b3528bc0-8a39-4ef1-baa8-ddd0c538477a-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "cinder-quobyte-fcd3e20a-f2bf-4364-acc7-6d49ebda0795" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-quobyte-fcd3e20a-f2bf-4364-acc7-6d49ebda0795" acquired by "delete_volume" :: waited 0.035s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3c6cd0-0b91-4a37-a5b6-b70620dfe69e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:11 devstack sudo[85554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795
Apr 28 02:19:11 devstack sudo[85554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:11 devstack sudo[85548]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f 1073741824" returned: 0 in 1.420s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:12 devstack sudo[85591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f
Apr 28 02:19:12 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:12 devstack sudo[85554]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795" returned: 0 in 1.450s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:12 devstack sudo[85594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795
Apr 28 02:19:12 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:12 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f" returned: 0 in 0.909s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] <== create_volume: return (2446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:19:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.449s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca530c1-5b6d-4223-b781-b4a28f6e300a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80336456-b59d-497a-a2a7-b82a1945e188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:13 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Volume volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f (8b48cc60-b85b-4611-b4c9-ea0f4247482f): created successfully
Apr 28 02:19:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80336456-b59d-497a-a2a7-b82a1945e188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Flow 'volume_create_manager' (38790ad4-9752-4725-9469-ee895c5cc15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:19:13 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-89e0480f-e8b6-4c67-a18d-37eeb0090259 tempest-VolumesTestJSON-915509355 None] Created volume successfully.
Apr 28 02:19:13 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fcd3e20a-f2bf-4364-acc7-6d49ebda0795" returned: 0 in 1.410s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-quobyte-fcd3e20a-f2bf-4364-acc7-6d49ebda0795" released by "delete_volume" :: held 2.930s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:13 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Created reservations ['7f67c691-003d-43a2-b870-d1f72054b76b', 'fd63e49e-fda9-4913-ac99-c25793f8cd7a', '05c28df6-40ad-4652-8292-570b4407099c', 'f6590d11-0db6-4188-8322-97653057a95f'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:19:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:14 devstack sudo[85600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:19:14 devstack sudo[85600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "cinder-7aff1e08-04dd-4538-80a3-dec1cb85724d-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-7aff1e08-04dd-4538-80a3-dec1cb85724d-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "cinder-quobyte-7aff1e08-04dd-4538-80a3-dec1cb85724d" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-quobyte-7aff1e08-04dd-4538-80a3-dec1cb85724d" acquired by "delete_volume" :: waited 0.040s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:14 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04f8f8b-9e8f-464f-adc1-4657f87e145b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7aff1e08-04dd-4538-80a3-dec1cb85724d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:14 devstack sudo[85602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7aff1e08-04dd-4538-80a3-dec1cb85724d
Apr 28 02:19:14 devstack sudo[85602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Flow 'volume_create_manager' (2068c4ac-bca9-4617-a1d1-b5588394aea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a28b700-b897-46fe-9156-380985a85a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a28b700-b897-46fe-9156-380985a85a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2074087093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f625c16-835f-41b2-a236-ba36507e7b15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ae6f8c3b081448a6a1ba911c9c506adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:19:15Z,use_quota=True,user_id='c69bc7e86b0e49ed9a3b5b134e4d6d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd000957-757a-4b58-9243-600fa650d3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd000957-757a-4b58-9243-600fa650d3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c0b851-2611-4f87-b05e-e42dba4a7eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c0b851-2611-4f87-b05e-e42dba4a7eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f625c16-835f-41b2-a236-ba36507e7b15', 'volume_name': 'volume-5f625c16-835f-41b2-a236-ba36507e7b15', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b0f5c8-d6ea-4587-a03d-7fae57f5c99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b0f5c8-d6ea-4587-a03d-7fae57f5c99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5499d77-9b18-4658-a7c0-f1bdb14fa6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:15 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Volume 5f625c16-835f-41b2-a236-ba36507e7b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f625c16-835f-41b2-a236-ba36507e7b15', 'volume_size': 1}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2074087093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f625c16-835f-41b2-a236-ba36507e7b15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ae6f8c3b081448a6a1ba911c9c506adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:19:15Z,use_quota=True,user_id='c69bc7e86b0e49ed9a3b5b134e4d6d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Creating volume 5f625c16-835f-41b2-a236-ba36507e7b15 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:19:15 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5f625c16-835f-41b2-a236-ba36507e7b15 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4bb11be2-648e-4afd-aa3e-3ee1eccf7b3d tempest-VolumesActionsTest-1998942808 None] Acquiring lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2" by "attach_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:15 devstack sudo[85604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5f625c16-835f-41b2-a236-ba36507e7b15 1073741824
Apr 28 02:19:15 devstack sudo[85604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4bb11be2-648e-4afd-aa3e-3ee1eccf7b3d tempest-VolumesActionsTest-1998942808 None] Lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2" acquired by "attach_volume" :: waited 0.077s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:15 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-4bb11be2-648e-4afd-aa3e-3ee1eccf7b3d tempest-VolumesActionsTest-1998942808 None] Attaching volume 776d4fe0-3bff-4403-9889-b8229813ffe2 to instance cbe2c0fd-ca8c-4ee4-a83a-46740d01712e at mountpoint /dev/vdb on host None.
Apr 28 02:19:15 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-4bb11be2-648e-4afd-aa3e-3ee1eccf7b3d tempest-VolumesActionsTest-1998942808 None] Attach volume completed successfully.
Apr 28 02:19:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4bb11be2-648e-4afd-aa3e-3ee1eccf7b3d tempest-VolumesActionsTest-1998942808 None] Lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2" released by "attach_volume" :: held 0.406s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:16 devstack sudo[85600]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.937s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:16 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:19:16 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Deleted volume successfully.
Apr 28 02:19:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70adc7b5-719d-44fd-bc69-19abae04199e tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-fcd3e20a-f2bf-4364-acc7-6d49ebda0795-delete_volume" released by "delete_volume" :: held 5.438s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:16 devstack sudo[85602]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7aff1e08-04dd-4538-80a3-dec1cb85724d" returned: 0 in 1.726s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7aff1e08-04dd-4538-80a3-dec1cb85724d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:16 devstack sudo[85612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7aff1e08-04dd-4538-80a3-dec1cb85724d
Apr 28 02:19:16 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-02502dbb-b218-4685-b914-f26e8827d6af tempest-VolumesActionsTest-1998942808 None] Acquiring lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2-detach_volume" by "detach_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-02502dbb-b218-4685-b914-f26e8827d6af tempest-VolumesActionsTest-1998942808 None] Lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:16 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-02502dbb-b218-4685-b914-f26e8827d6af tempest-VolumesActionsTest-1998942808 None] Detaching volume 776d4fe0-3bff-4403-9889-b8229813ffe2 from instance cbe2c0fd-ca8c-4ee4-a83a-46740d01712e.
Apr 28 02:19:17 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-02502dbb-b218-4685-b914-f26e8827d6af tempest-VolumesActionsTest-1998942808 None] Detach volume completed successfully.
Apr 28 02:19:17 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-02502dbb-b218-4685-b914-f26e8827d6af tempest-VolumesActionsTest-1998942808 None] Lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2-detach_volume" released by "detach_volume" :: held 0.150s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:17 devstack sudo[85604]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5f625c16-835f-41b2-a236-ba36507e7b15 1073741824" returned: 0 in 2.606s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5f625c16-835f-41b2-a236-ba36507e7b15 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:18 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7aff1e08-04dd-4538-80a3-dec1cb85724d" returned: 0 in 1.665s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:18 devstack sudo[85634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5f625c16-835f-41b2-a236-ba36507e7b15
Apr 28 02:19:18 devstack sudo[85634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-quobyte-7aff1e08-04dd-4538-80a3-dec1cb85724d" released by "delete_volume" :: held 3.551s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:18 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Created reservations ['47455675-2bbb-4844-9bc8-312af87c2f8d', 'ff4f382c-9627-47b5-8348-a700984d12b7', 'f28a4a4e-7c87-41c5-b19c-874907504d3c', 'a6afb701-8367-4ef8-b5eb-45fb3d641ba9'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:19:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:18 devstack sudo[85640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:19:18 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:19 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "cinder-929ff7e4-2aea-4a29-9799-397519b6230f-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:19 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-929ff7e4-2aea-4a29-9799-397519b6230f-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "cinder-quobyte-929ff7e4-2aea-4a29-9799-397519b6230f" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-quobyte-929ff7e4-2aea-4a29-9799-397519b6230f" acquired by "delete_volume" :: waited 0.040s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30ca95b-96a9-4b92-ab96-f174541695d7]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-929ff7e4-2aea-4a29-9799-397519b6230f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:20 devstack sudo[85634]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5f625c16-835f-41b2-a236-ba36507e7b15" returned: 0 in 2.277s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] <== create_volume: return (5019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.022s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5499d77-9b18-4658-a7c0-f1bdb14fa6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f625c16-835f-41b2-a236-ba36507e7b15', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ca0608-17ca-4fa5-9b32-a2a6cbc39183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:20 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Volume volume-5f625c16-835f-41b2-a236-ba36507e7b15 (5f625c16-835f-41b2-a236-ba36507e7b15): created successfully
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ca0608-17ca-4fa5-9b32-a2a6cbc39183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Flow 'volume_create_manager' (2068c4ac-bca9-4617-a1d1-b5588394aea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:19:20 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-060fb9bb-3a2e-410b-8738-6591eb5f9f2a tempest-VolumesTestJSON-915509355 None] Created volume successfully.
Apr 28 02:19:20 devstack sudo[85693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-929ff7e4-2aea-4a29-9799-397519b6230f
Apr 28 02:19:20 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:20 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.820s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:19:20 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Deleted volume successfully.
Apr 28 02:19:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-924f59c3-d28a-47be-aa1e-dcba235aadef tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-7aff1e08-04dd-4538-80a3-dec1cb85724d-delete_volume" released by "delete_volume" :: held 6.156s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:21 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-929ff7e4-2aea-4a29-9799-397519b6230f" returned: 0 in 1.421s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-929ff7e4-2aea-4a29-9799-397519b6230f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:21 devstack sudo[85728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-929ff7e4-2aea-4a29-9799-397519b6230f
Apr 28 02:19:21 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Acquiring lock "cinder-5f625c16-835f-41b2-a236-ba36507e7b15-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Lock "cinder-5f625c16-835f-41b2-a236-ba36507e7b15-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Acquiring lock "cinder-quobyte-5f625c16-835f-41b2-a236-ba36507e7b15" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Lock "cinder-quobyte-5f625c16-835f-41b2-a236-ba36507e7b15" acquired by "delete_volume" :: waited 0.029s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9b394e-09c1-40ea-b1eb-91583efa5eac]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5f625c16-835f-41b2-a236-ba36507e7b15 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:22 devstack sudo[85731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5f625c16-835f-41b2-a236-ba36507e7b15
Apr 28 02:19:22 devstack sudo[85731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:22 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-929ff7e4-2aea-4a29-9799-397519b6230f" returned: 0 in 0.727s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-quobyte-929ff7e4-2aea-4a29-9799-397519b6230f" released by "delete_volume" :: held 2.214s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Created reservations ['c73fc5dd-f496-4097-82cc-cd9ebb281fea', 'aa6e10c2-e375-4f99-b726-c67a3013b537', '15893590-27a6-4189-a794-7202da87fbf2', '80666c80-5b75-47a4-90fe-6cbe3b4b5468'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:22 devstack sudo[85736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:19:22 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:22 devstack sudo[85731]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5f625c16-835f-41b2-a236-ba36507e7b15" returned: 0 in 0.677s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5f625c16-835f-41b2-a236-ba36507e7b15 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:22 devstack sudo[85746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5f625c16-835f-41b2-a236-ba36507e7b15
Apr 28 02:19:22 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:23 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.507s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:19:23 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Deleted volume successfully.
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-71d96454-17fc-4b02-a19a-a555c27f42ab tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-929ff7e4-2aea-4a29-9799-397519b6230f-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:23 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5f625c16-835f-41b2-a236-ba36507e7b15" returned: 0 in 0.474s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Lock "cinder-quobyte-5f625c16-835f-41b2-a236-ba36507e7b15" released by "delete_volume" :: held 1.193s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Created reservations ['8bd8d72c-63fd-403f-a70c-267fa63e3a1a', '58914260-5f77-4700-be57-25de6f1d1c0e', '94ca6481-43df-4522-a794-8cfe10923317', '27ca95be-f473-414a-8e03-2de32a5c7ff9'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "cinder-fd1c3342-f2e1-48e1-aa75-897a3571f27a-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-fd1c3342-f2e1-48e1-aa75-897a3571f27a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:23 devstack sudo[85750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:19:23 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "cinder-quobyte-fd1c3342-f2e1-48e1-aa75-897a3571f27a" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-quobyte-fd1c3342-f2e1-48e1-aa75-897a3571f27a" acquired by "delete_volume" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[952a19af-c4bc-45f9-bd77-1a2caa0aaa50]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:23 devstack sudo[85752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a
Apr 28 02:19:23 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:24 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.528s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:19:24 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Deleted volume successfully.
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b1371eb-a7e5-4f56-a1c9-0a9a7d529b22 tempest-VolumesTestJSON-915509355 None] Lock "cinder-5f625c16-835f-41b2-a236-ba36507e7b15-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:24 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a" returned: 0 in 0.597s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:24 devstack sudo[85758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a
Apr 28 02:19:24 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Acquiring lock "cinder-8b48cc60-b85b-4611-b4c9-ea0f4247482f-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Lock "cinder-8b48cc60-b85b-4611-b4c9-ea0f4247482f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Acquiring lock "cinder-quobyte-8b48cc60-b85b-4611-b4c9-ea0f4247482f" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Lock "cinder-quobyte-8b48cc60-b85b-4611-b4c9-ea0f4247482f" acquired by "delete_volume" :: waited 0.025s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[763e86dd-3a56-4a2b-8946-b74e4596b283]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:24 devstack sudo[85760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f
Apr 28 02:19:24 devstack sudo[85760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:24 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd1c3342-f2e1-48e1-aa75-897a3571f27a" returned: 0 in 0.589s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-quobyte-fd1c3342-f2e1-48e1-aa75-897a3571f27a" released by "delete_volume" :: held 1.223s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Created reservations ['c6668dd9-f627-46b2-9625-472f2d1333f3', 'a205f98d-25e4-46ec-9239-d5daac67066c', '5ef8a147-d17d-42d4-830a-059376410508', '604b367c-d650-403f-a367-4dafa98af563'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:24 devstack sudo[85765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:19:24 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:25 devstack sudo[85760]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f" returned: 0 in 0.682s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:25 devstack sudo[85770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f
Apr 28 02:19:25 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:25 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.456s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:19:25 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Deleted volume successfully.
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-15a1e04b-5351-4631-bad7-13d53a093ccd tempest-CreateVolumesFromSourceVolumeTest-1223827465 None] Lock "cinder-fd1c3342-f2e1-48e1-aa75-897a3571f27a-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:25 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b48cc60-b85b-4611-b4c9-ea0f4247482f" returned: 0 in 0.451s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Lock "cinder-quobyte-8b48cc60-b85b-4611-b4c9-ea0f4247482f" released by "delete_volume" :: held 1.197s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Created reservations ['2379e215-02e4-4032-b7d5-487ca0b4e67c', 'b584e393-877d-42f8-9f55-8b69a6cea054', '04220a2e-6f48-4ac5-addf-5962be1bef99', '18a4e849-fcb5-4d94-aa5e-495138a85cff'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:25 devstack sudo[85774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:19:25 devstack sudo[85774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:26 devstack sudo[85774]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.541s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:26 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:19:26 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Deleted volume successfully.
Apr 28 02:19:26 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-10eab482-7187-4fb6-8f29-6c6b3d8dc15e tempest-VolumesTestJSON-915509355 None] Lock "cinder-8b48cc60-b85b-4611-b4c9-ea0f4247482f-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:26 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Acquiring lock "cinder-eeeba5af-f57c-42b7-88be-38fac13667ab-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:26 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Lock "cinder-eeeba5af-f57c-42b7-88be-38fac13667ab-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:26 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Acquiring lock "cinder-quobyte-eeeba5af-f57c-42b7-88be-38fac13667ab" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:19:26 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Lock "cinder-quobyte-eeeba5af-f57c-42b7-88be-38fac13667ab" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:19:26 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0b8dc5-d8f2-499e-a993-9336c5b4d905]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-eeeba5af-f57c-42b7-88be-38fac13667ab {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:26 devstack sudo[85783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-eeeba5af-f57c-42b7-88be-38fac13667ab
Apr 28 02:19:26 devstack sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:27 devstack sudo[85783]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-eeeba5af-f57c-42b7-88be-38fac13667ab" returned: 0 in 0.800s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-eeeba5af-f57c-42b7-88be-38fac13667ab {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:27 devstack sudo[85799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-eeeba5af-f57c-42b7-88be-38fac13667ab
Apr 28 02:19:27 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:28 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bae8e9-392d-47e1-8db1-b98606cdb558]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:28 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-eeeba5af-f57c-42b7-88be-38fac13667ab" returned: 0 in 0.842s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Lock "cinder-quobyte-eeeba5af-f57c-42b7-88be-38fac13667ab" released by "delete_volume" :: held 1.717s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:28 devstack sudo[85835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2
Apr 28 02:19:28 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:28 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Created reservations ['a3dc04b5-8746-4deb-bec5-e50d06bfa25d', 'c56b54dc-e06c-4eb7-a717-0eea1889b783', '33911e5c-019a-46cd-8f87-12e988e56281', 'ff97c8e8-0138-4bea-ae79-e72d942cc5a0'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:19:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:28 devstack sudo[85837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:19:28 devstack sudo[85837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:29 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2" returned: 0 in 0.795s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:29 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5789a7ad-d86a-4a0d-9c8a-c2d092fdcfb4]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:29 devstack sudo[85837]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.638s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:29 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:19:29 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Deleted volume successfully.
Apr 28 02:19:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3ba30567-cc80-4dc7-8662-2325e87efc60 tempest-VolumesTestJSON-915509355 None] Lock "cinder-eeeba5af-f57c-42b7-88be-38fac13667ab-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:19:29 devstack sudo[85843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2
Apr 28 02:19:29 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:29 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2" returned: 0 in 0.603s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.5501eeab-9def-4c88-81a3-d46a10bd1673z5qsnnij.img {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:29 devstack sudo[85848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.5501eeab-9def-4c88-81a3-d46a10bd1673z5qsnnij.img
Apr 28 02:19:29 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:32 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:19:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Flow 'volume_create_manager' (14364f36-5817-4299-8ace-af0de438c511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:19:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bc6f23-091c-4ecf-9e72-a319e9885fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10bc6f23-091c-4ecf-9e72-a319e9885fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1632439269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc25617d-b280-4ffd-8413-1fa1e8e22597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadfda9b0f04400d9894a8c0c2b2eba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:19:33Z,use_quota=True,user_id='11c934b85df54a58a34cdf2fdcfa3170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a508ce-d59e-4166-9700-6f5c1b0c8c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a508ce-d59e-4166-9700-6f5c1b0c8c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8862c3bb-4e72-4106-96b7-541690600be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8862c3bb-4e72-4106-96b7-541690600be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc25617d-b280-4ffd-8413-1fa1e8e22597', 'volume_name': 'volume-bc25617d-b280-4ffd-8413-1fa1e8e22597', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d55308-1d47-492d-af84-75dc7629e875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85d55308-1d47-492d-af84-75dc7629e875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb0df90-8522-4e68-91f3-5b50f35fe6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:32 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Volume bc25617d-b280-4ffd-8413-1fa1e8e22597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc25617d-b280-4ffd-8413-1fa1e8e22597', 'volume_size': 1}
Apr 28 02:19:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:37 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.5501eeab-9def-4c88-81a3-d46a10bd1673z5qsnnij.img" returned: 0 in 7.351s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:37 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6e1237-0a1f-41bc-9e6a-322245d6cb14]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:37 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b8165d22-fbf4-4a26-a290-da8a165d9b3c tempest-GroupSnapshotsTest-1032638190 None] Group tempest-GroupSnapshotsTest-Group-184284008: creating
Apr 28 02:19:37 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b8165d22-fbf4-4a26-a290-da8a165d9b3c tempest-GroupSnapshotsTest-1032638190 None] Group tempest-GroupSnapshotsTest-Group-184284008: created successfully
Apr 28 02:19:37 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b8165d22-fbf4-4a26-a290-da8a165d9b3c tempest-GroupSnapshotsTest-1032638190 None] Create group completed successfully.
Apr 28 02:19:37 devstack sudo[85863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2
Apr 28 02:19:37 devstack sudo[85863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:37 devstack sudo[85863]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2" returned: 0 in 0.653s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:37 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2, size 1024.00 MB, duration 7.35 sec, destination /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.5501eeab-9def-4c88-81a3-d46a10bd1673z5qsnnij.img {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:19:37 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] Converted 1024.00 MB image at 139.28 MB/s
Apr 28 02:19:37 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=102,cinder:INSERT=41,cinder:UPDATE=124,cinder:DELETE=13 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:19:37 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:DELETE=9,cinder:SELECT=93,cinder:INSERT=21,cinder:UPDATE=138 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:19:37 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] 5501eeab-9def-4c88-81a3-d46a10bd1673 was raw, no need to convert to raw {{(pid=81489) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 28 02:19:38 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:19:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Flow 'volume_create_manager' (c4dd9a77-75ad-42c2-8113-e98db97e5e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:19:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d731c3f-b1b5-4570-aee6-f651192ff527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d731c3f-b1b5-4570-aee6-f651192ff527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-35131238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a05bd0ff-4944-4d49-9f62-14fae0348a00,host='devstack@QuobyteHD#QuobyteHD',id=8d5cc8be-43ae-40df-abb9-4781fab82eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8768b3217159430b8961f17fa96f1886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:19:39Z,use_quota=True,user_id='b3ff9eae8a35418aa4fbf360a6c3bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(223d5d07-eb12-43de-98bd-069828fec6da),volume_type_id=223d5d07-eb12-43de-98bd-069828fec6da)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27eccd95-a867-4b70-b76c-5d45d8f4b160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27eccd95-a867-4b70-b76c-5d45d8f4b160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac725a51-20a3-4c76-981f-70fea2150094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac725a51-20a3-4c76-981f-70fea2150094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d5cc8be-43ae-40df-abb9-4781fab82eb0', 'volume_name': 'volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83771b5d-b291-4b03-9e3f-a5735deaf85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83771b5d-b291-4b03-9e3f-a5735deaf85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e84d9e-d847-498f-b6b6-1e4836f2a782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:38 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Volume 8d5cc8be-43ae-40df-abb9-4781fab82eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0', 'volume_size': 1}
Apr 28 02:19:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:48 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:19:48 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=1 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:19:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:19:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:52 devstack sudo[85926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:19:52 devstack sudo[85926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:53 devstack sudo[85926]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.538s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.161s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] Uploaded volume to glance image-id: 5501eeab-9def-4c88-81a3-d46a10bd1673. {{(pid=81489) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.664s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1632439269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc25617d-b280-4ffd-8413-1fa1e8e22597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadfda9b0f04400d9894a8c0c2b2eba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:19:33Z,use_quota=True,user_id='11c934b85df54a58a34cdf2fdcfa3170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Creating volume bc25617d-b280-4ffd-8413-1fa1e8e22597 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:19:53 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:19:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bc25617d-b280-4ffd-8413-1fa1e8e22597 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:53 devstack sudo[85929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bc25617d-b280-4ffd-8413-1fa1e8e22597 1073741824
Apr 28 02:19:53 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:53 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-043f4fbc-6ed0-4c83-9f08-bf8640c68672 tempest-VolumesActionsTest-1998942808 None] Copy volume to image completed successfully.
Apr 28 02:19:54 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bc25617d-b280-4ffd-8413-1fa1e8e22597 1073741824" returned: 0 in 0.599s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bc25617d-b280-4ffd-8413-1fa1e8e22597 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:54 devstack sudo[85934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bc25617d-b280-4ffd-8413-1fa1e8e22597
Apr 28 02:19:54 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:54 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bc25617d-b280-4ffd-8413-1fa1e8e22597" returned: 0 in 0.456s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.788s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a05bd0ff-4944-4d49-9f62-14fae0348a00,created_at=2026-04-28T00:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-35131238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a05bd0ff-4944-4d49-9f62-14fae0348a00,host='devstack@QuobyteHD#QuobyteHD',id=8d5cc8be-43ae-40df-abb9-4781fab82eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8768b3217159430b8961f17fa96f1886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:19:39Z,use_quota=True,user_id='b3ff9eae8a35418aa4fbf360a6c3bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(223d5d07-eb12-43de-98bd-069828fec6da),volume_type_id=223d5d07-eb12-43de-98bd-069828fec6da)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Creating volume 8d5cc8be-43ae-40df-abb9-4781fab82eb0 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:19:54 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb0df90-8522-4e68-91f3-5b50f35fe6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc25617d-b280-4ffd-8413-1fa1e8e22597', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:54 devstack sudo[85937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 1073741824
Apr 28 02:19:54 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c7fe47-d94f-4e8f-8bdf-33e40d5f32a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:54 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Volume volume-bc25617d-b280-4ffd-8413-1fa1e8e22597 (bc25617d-b280-4ffd-8413-1fa1e8e22597): created successfully
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c7fe47-d94f-4e8f-8bdf-33e40d5f32a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Flow 'volume_create_manager' (14364f36-5817-4299-8ace-af0de438c511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:19:54 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-334e82ba-9c78-4736-a5ba-bf118e1c3233 tempest-ServerRescueNegativeTestJSON-1714703819 None] Created volume successfully.
Apr 28 02:19:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:55 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 1073741824" returned: 0 in 0.737s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:55 devstack sudo[85943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0
Apr 28 02:19:55 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:55 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0" returned: 0 in 0.471s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:19:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:19:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.583s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:19:55 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[65976838-256b-41aa-94fe-74377e9ec877]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e84d9e-d847-498f-b6b6-1e4836f2a782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e013fab7-3d89-4228-8819-d65400d1ed93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:19:55 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Volume volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 (8d5cc8be-43ae-40df-abb9-4781fab82eb0): created successfully
Apr 28 02:19:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e013fab7-3d89-4228-8819-d65400d1ed93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:19:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Flow 'volume_create_manager' (c4dd9a77-75ad-42c2-8113-e98db97e5e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:19:55 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b2bc0ec4-6da0-4056-baa9-6959a2e74732 tempest-GroupSnapshotsTest-1032638190 None] Created volume successfully.
Apr 28 02:19:56 devstack sudo[85946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2
Apr 28 02:19:56 devstack sudo[85946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:56 devstack sudo[85946]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2" returned: 0 in 0.583s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:56 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[413481af-6dee-4a15-977b-01897fcc25a0]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:19:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:56 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] GroupSnapshot 35cf4da0-a160-496a-9918-e3c05594ae07: creating.
Apr 28 02:19:56 devstack sudo[85951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2
Apr 28 02:19:56 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:19:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] Group snapshot 35cf4da0-a160-496a-9918-e3c05594ae07: creating. {{(pid=81489) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 28 02:19:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:19:57 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root
Apr 28 02:19:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2" returned: 0 in 0.616s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:19:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:19:57 devstack sudo[85957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img
Apr 28 02:19:57 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:02 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img" returned: 0 in 5.024s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:02 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a5cbb6-2b90-402f-aaa9-b7563a85784c]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:02 devstack sudo[86006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2
Apr 28 02:20:02 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:02 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2" returned: 0 in 0.655s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:02 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:20:02 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Converted 1024.00 MB image at 203.78 MB/s
Apr 28 02:20:02 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] 2cffd9ff-c47d-436a-9de5-5434fb095d5f was raw, converting to qcow2 {{(pid=81489) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 28 02:20:02 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb65d5f6-d140-43fb-8e68-7ad9f99d92a3]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:02 devstack sudo[86011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img
Apr 28 02:20:02 devstack sudo[86011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:03 devstack sudo[86011]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img" returned: 0 in 0.516s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:03 devstack sudo[86017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img
Apr 28 02:20:03 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:03 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img" returned: 1 in 0.496s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:20:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img /opt/stack/data/cinder/conversion/vol_upload_fac0nj94 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:03 devstack sudo[86022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img /opt/stack/data/cinder/conversion/vol_upload_fac0nj94
Apr 28 02:20:03 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:04 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img /opt/stack/data/cinder/conversion/vol_upload_fac0nj94" returned: 0 in 0.451s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:04 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Image conversion details: src /opt/stack/data/cinder/conversion/776d4fe0-3bff-4403-9889-b8229813ffe2.temp_image.2cffd9ff-c47d-436a-9de5-5434fb095d5fqifyzz90.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_fac0nj94 {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:20:04 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 28 02:20:04 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[febb9c1e-e3c0-45d2-8db2-95bdca81321b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fac0nj94 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:04 devstack sudo[86027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fac0nj94
Apr 28 02:20:04 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:04 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fac0nj94" returned: 0 in 0.472s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.130s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Uploaded volume to glance image-id: 2cffd9ff-c47d-436a-9de5-5434fb095d5f. {{(pid=81489) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 28 02:20:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.345s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:06 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] Creating offline snapshot d5ac9f4d-5da1-453d-aa03-d90b521def39 of volume 8d5cc8be-43ae-40df-abb9-4781fab82eb0 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:20:06 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bd6507-74f4-40e2-a31f-2c724a49ac2f]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:06 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-83e1931b-4be9-4361-9813-5920ca1ef337 tempest-VolumesActionsTest-1998942808 None] Copy volume to image completed successfully.
Apr 28 02:20:06 devstack sudo[86046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0
Apr 28 02:20:06 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:06 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0" returned: 0 in 0.769s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:06 devstack sudo[86084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39 1G
Apr 28 02:20:06 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:07 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Acquiring lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:07 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:07 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Acquiring lock "cinder-quobyte-776d4fe0-3bff-4403-9889-b8229813ffe2" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:07 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Lock "cinder-quobyte-776d4fe0-3bff-4403-9889-b8229813ffe2" acquired by "delete_volume" :: waited 0.029s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:07 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b383520-b2f7-4375-877b-a17021184a52]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:07 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39 1G" returned: 0 in 0.888s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:07 devstack sudo[86091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39
Apr 28 02:20:07 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:07 devstack sudo[86090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2
Apr 28 02:20:07 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:08 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2" returned: 0 in 0.695s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:08 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39" returned: 0 in 0.662s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:08 devstack sudo[86101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2
Apr 28 02:20:08 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:08 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39 is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:20:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:08 devstack sudo[86103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39
Apr 28 02:20:08 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:08 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-776d4fe0-3bff-4403-9889-b8229813ffe2" returned: 0 in 0.493s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:08 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Lock "cinder-quobyte-776d4fe0-3bff-4403-9889-b8229813ffe2" released by "delete_volume" :: held 1.238s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:08 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39" returned: 0 in 0.523s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:09 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Created reservations ['4ae381a3-26da-4a67-95aa-b82c6d493a11', 'b206fbaf-44cb-4c89-a773-5ceb96b4b593', 'eb1b22b7-78de-428f-9227-efa41a014777', 'c8490acb-5b8b-4d1d-881f-18421d5975a0'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:20:09 devstack sudo[86107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.info
Apr 28 02:20:09 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:09 devstack sudo[86109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:20:09 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:09 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.info" returned: 0 in 0.587s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:09 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:20:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:09 devstack sudo[86113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.info
Apr 28 02:20:09 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:09 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.566s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:09 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:20:09 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Deleted volume successfully.
Apr 28 02:20:09 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5677fcc7-a768-471e-92c2-035acf3de5a5 tempest-VolumesActionsTest-1998942808 None] Lock "cinder-776d4fe0-3bff-4403-9889-b8229813ffe2-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:10 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.info" returned: 0 in 0.592s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.124s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:10 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-7b095e8a-573b-4d2d-a04b-96fb0e0baee8 tempest-GroupSnapshotsTest-1032638190 None] group_snapshot 35cf4da0-a160-496a-9918-e3c05594ae07: created successfully
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-d5ac9f4d-5da1-453d-aa03-d90b521def39-21190b60-18ca-4239-86af-03f21997bfd0" by "_create_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-d5ac9f4d-5da1-453d-aa03-d90b521def39-21190b60-18ca-4239-86af-03f21997bfd0" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Creating volume 21190b60-18ca-4239-86af-03f21997bfd0 from snapshot d5ac9f4d-5da1-453d-aa03-d90b521def39 {{(pid=81489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-21190b60-18ca-4239-86af-03f21997bfd0" by "_copy_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-21190b60-18ca-4239-86af-03f21997bfd0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] snapshot: d5ac9f4d-5da1-453d-aa03-d90b521def39, volume: 21190b60-18ca-4239-86af-03f21997bfd0,  {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bcec0d-f0c7-4276-a706-a0256d67901b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:12 devstack sudo[86156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39
Apr 28 02:20:12 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:13 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39" returned: 0 in 0.837s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:20:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 02:20:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Creating direct copy from snapshot {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 02:20:13 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9410fe90-d8e4-4339-b49b-d5cff993c619]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:13 devstack sudo[86183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0
Apr 28 02:20:13 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:14 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0" returned: 0 in 0.789s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:14 devstack cinder-volume[81489]: DEBUG cinder.utils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Path /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0 not found in is_blk_device check {{(pid=81489) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 02:20:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:14 devstack sudo[86203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0
Apr 28 02:20:14 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Acquiring lock "cinder-bc25617d-b280-4ffd-8413-1fa1e8e22597-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Lock "cinder-bc25617d-b280-4ffd-8413-1fa1e8e22597-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Acquiring lock "cinder-quobyte-bc25617d-b280-4ffd-8413-1fa1e8e22597" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Lock "cinder-quobyte-bc25617d-b280-4ffd-8413-1fa1e8e22597" acquired by "delete_volume" :: waited 0.118s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:16 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[62097a63-2778-4b9a-acb7-31d7c7898ee8]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bc25617d-b280-4ffd-8413-1fa1e8e22597 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:16 devstack sudo[86219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bc25617d-b280-4ffd-8413-1fa1e8e22597
Apr 28 02:20:16 devstack sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:18 devstack sudo[86219]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bc25617d-b280-4ffd-8413-1fa1e8e22597" returned: 0 in 2.130s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bc25617d-b280-4ffd-8413-1fa1e8e22597 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:18 devstack sudo[86238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bc25617d-b280-4ffd-8413-1fa1e8e22597
Apr 28 02:20:18 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:20 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:20:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Flow 'volume_create_manager' (2e5489fc-77a6-41ec-a100-40c7896730cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:20:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff43e5d1-3393-423f-b59f-ae0926d25807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff43e5d1-3393-423f-b59f-ae0926d25807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-855706259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e86164f-b9d9-4f21-9673-db94d0e09fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78e69a8156b4d81b7c63181930a388c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:20:20Z,use_quota=True,user_id='c63f4cb2e6ef46ae9e1768ee7aedd8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4658d9d-39ce-4a44-9916-5d5d1ceda710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4658d9d-39ce-4a44-9916-5d5d1ceda710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99efda33-61a9-459e-b9a5-c3a113ea2e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99efda33-61a9-459e-b9a5-c3a113ea2e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e86164f-b9d9-4f21-9673-db94d0e09fc3', 'volume_name': 'volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc8fdba-b842-4eea-983b-b49349e6dc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc8fdba-b842-4eea-983b-b49349e6dc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51d4e57-4f22-4130-876f-76837b2897cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:20 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Volume 9e86164f-b9d9-4f21-9673-db94d0e09fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3', 'volume_size': 1}
Apr 28 02:20:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:21 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bc25617d-b280-4ffd-8413-1fa1e8e22597" returned: 0 in 2.421s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:21 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Lock "cinder-quobyte-bc25617d-b280-4ffd-8413-1fa1e8e22597" released by "delete_volume" :: held 4.705s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:21 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Created reservations ['883bfb56-a3d4-4654-97f7-cade036b00a1', 'b7f9e070-3cbe-40ec-98f7-9a2f7e8eca45', 'e439b246-9288-4db4-b285-dd8d2d5ea4d9', '85f4c0f4-b38e-4ad8-8ebe-399014e67ef4'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:20:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:21 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:21 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:21 devstack sudo[86253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:20:21 devstack sudo[86253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:22 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0" returned: 0 in 8.223s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:22 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0f53f4-82d2-4758-a5fd-3110840010a6]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:22 devstack sudo[86256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0
Apr 28 02:20:22 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:22 devstack sudo[86253]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.099s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:22 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:20:22 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Deleted volume successfully.
Apr 28 02:20:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-640f9638-3ea5-477c-9337-34b3d16a7af9 tempest-ServerRescueNegativeTestJSON-1714703819 None] Lock "cinder-bc25617d-b280-4ffd-8413-1fa1e8e22597-delete_volume" released by "delete_volume" :: held 6.651s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:23 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0" returned: 0 in 0.827s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0, size 1024.00 MB, duration 8.23 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0 {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:20:23 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Converted 1024.00 MB image at 124.47 MB/s
Apr 28 02:20:23 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0 is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:23 devstack sudo[86262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0
Apr 28 02:20:23 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:23 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0" returned: 0 in 0.572s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-21190b60-18ca-4239-86af-03f21997bfd0" released by "_copy_volume_from_snapshot" :: held 11.398s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-d5ac9f4d-5da1-453d-aa03-d90b521def39-21190b60-18ca-4239-86af-03f21997bfd0" released by "_create_volume_from_snapshot" :: held 11.445s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.476s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.111s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-855706259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e86164f-b9d9-4f21-9673-db94d0e09fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78e69a8156b4d81b7c63181930a388c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:20:20Z,use_quota=True,user_id='c63f4cb2e6ef46ae9e1768ee7aedd8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Creating volume 9e86164f-b9d9-4f21-9673-db94d0e09fc3 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:20:23 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:20:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:24 devstack sudo[86276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 1073741824
Apr 28 02:20:24 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:24 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-7837b812-a837-422f-a815-49df15e6b6b4 tempest-GroupSnapshotsTest-1032638190 None] Create group from source-snapshot-35cf4da0-a160-496a-9918-e3c05594ae07 completed successfully.
Apr 28 02:20:24 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 1073741824" returned: 0 in 1.017s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:25 devstack sudo[86304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3
Apr 28 02:20:25 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-21190b60-18ca-4239-86af-03f21997bfd0" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-21190b60-18ca-4239-86af-03f21997bfd0" acquired by "delete_volume" :: waited 0.024s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:25 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3908f0ee-0137-4329-9eeb-dbb54c175a80]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:25 devstack sudo[86306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0
Apr 28 02:20:25 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:25 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3" returned: 0 in 0.725s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:20:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51d4e57-4f22-4130-876f-76837b2897cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbf5542-7c53-4588-88d9-8e2c4111682a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:25 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Volume volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 (9e86164f-b9d9-4f21-9673-db94d0e09fc3): created successfully
Apr 28 02:20:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbf5542-7c53-4588-88d9-8e2c4111682a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Flow 'volume_create_manager' (2e5489fc-77a6-41ec-a100-40c7896730cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:20:25 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b5a9275e-23c6-40bf-a5ab-97c164d1105d tempest-VolumesCloneTest-1189072738 None] Created volume successfully.
Apr 28 02:20:26 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0" returned: 0 in 0.879s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:26 devstack sudo[86314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0
Apr 28 02:20:26 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:26 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-21190b60-18ca-4239-86af-03f21997bfd0" returned: 0 in 0.457s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:26 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-21190b60-18ca-4239-86af-03f21997bfd0" released by "delete_volume" :: held 1.379s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:26 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Created reservations ['58d95bec-ebd2-495c-ba28-0dace8daaa9e'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:20:26 devstack cinder-volume[81489]: WARNING cinder.quota [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1124623804 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1124623804, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:20:26 devstack cinder-volume[81489]: WARNING cinder.quota [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1124623804 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1124623804, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:20:26 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Created reservations ['baac8b62-10d7-48fc-b75a-f854f041f6e0', '6ac4a198-5723-47f7-a2cb-ec71876bbd63', '60e3a458-972a-436d-96db-1f62ba8d9146', 'd0f6732f-21d0-4a1b-981b-855436fc4b0f'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:20:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:26 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:20:26 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:27 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.495s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:20:27 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-c55075c8-a90d-4ab2-8d3b-bc1cdfbce53f tempest-GroupSnapshotsTest-1032638190 None] Delete group completed successfully.
Apr 28 02:20:27 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] group_snapshot 35cf4da0-a160-496a-9918-e3c05594ae07: deleting
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] group_snapshot 35cf4da0-a160-496a-9918-e3c05594ae07: deleting {{(pid=81489) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Flow 'volume_create_manager' (e7e9b752-4f24-4912-b34d-2be3de2957f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7129a6-aee9-4f20-9b85-1d888341db5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7129a6-aee9-4f20-9b85-1d888341db5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-519472244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34176868-d58e-48f6-b324-9cc6ec2c48dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78e69a8156b4d81b7c63181930a388c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:20:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=9e86164f-b9d9-4f21-9673-db94d0e09fc3,status='creating',terminated_at=None,updated_at=2026-04-28T00:20:27Z,use_quota=True,user_id='c63f4cb2e6ef46ae9e1768ee7aedd8b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b731722c-3205-412f-9370-5749edc48e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b731722c-3205-412f-9370-5749edc48e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7238bd-d08a-4f41-ba4d-aecb23ac696b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-8d5cc8be-43ae-40df-abb9-4781fab82eb0" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7238bd-d08a-4f41-ba4d-aecb23ac696b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '34176868-d58e-48f6-b324-9cc6ec2c48dd', 'volume_name': 'volume-34176868-d58e-48f6-b324-9cc6ec2c48dd', 'volume_size': 2, 'source_volid': '9e86164f-b9d9-4f21-9673-db94d0e09fc3', 'source_volstatus': 'available'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3f9dda-d310-461e-89f0-8a81509bd7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3f9dda-d310-461e-89f0-8a81509bd7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedce58c-7921-4b3e-8819-b4abb381d006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:27 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Volume 34176868-d58e-48f6-b324-9cc6ec2c48dd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-34176868-d58e-48f6-b324-9cc6ec2c48dd', 'volume_size': 2, 'source_volid': '9e86164f-b9d9-4f21-9673-db94d0e09fc3', 'source_volstatus': 'available'}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:27 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Cloning volume 9e86164f-b9d9-4f21-9673-db94d0e09fc3 to volume 34176868-d58e-48f6-b324-9cc6ec2c48dd
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-8d5cc8be-43ae-40df-abb9-4781fab82eb0" acquired by "delete_snapshot" :: waited 0.048s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-d5ac9f4d-5da1-453d-aa03-d90b521def39" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-d5ac9f4d-5da1-453d-aa03-d90b521def39" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Deleting offline snapshot d5ac9f4d-5da1-453d-aa03-d90b521def39 of volume 8d5cc8be-43ae-40df-abb9-4781fab82eb0 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] snapshot_file for this snap is: volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Creating offline snapshot ec154ab9-6f36-429d-b491-de8ea4e029a9 of volume 9e86164f-b9d9-4f21-9673-db94d0e09fc3 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b80e84-d40a-4760-9790-e904d15c371c]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2524f863-ab85-4499-9c43-435400856334]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:27 devstack sudo[86326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39
Apr 28 02:20:27 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:27 devstack sudo[86327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3
Apr 28 02:20:27 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:28 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39" returned: 0 in 0.550s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:20:28 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3" returned: 0 in 0.556s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:28 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b69e14-9308-44a5-a0be-e44db2cb44ca]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:28 devstack sudo[86336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9 1G
Apr 28 02:20:28 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:28 devstack sudo[86337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0
Apr 28 02:20:28 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:28 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0" returned: 0 in 0.578s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:28 devstack sudo[86346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39
Apr 28 02:20:28 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:28 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9 1G" returned: 0 in 0.623s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:28 devstack sudo[86348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9
Apr 28 02:20:28 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:29 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9" returned: 0 in 0.499s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:29 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9 is being set with open permissions: ugo+rw
Apr 28 02:20:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:29 devstack sudo[86356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9
Apr 28 02:20:29 devstack sudo[86356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:29 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39" returned: 0 in 0.572s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:29 devstack sudo[86358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39
Apr 28 02:20:29 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:29 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:29 devstack sudo[86356]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0.d5ac9f4d-5da1-453d-aa03-d90b521def39" returned: 0 in 0.451s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9" returned: 0 in 0.513s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-d5ac9f4d-5da1-453d-aa03-d90b521def39" released by "_delete_snapshot" :: held 2.264s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-8d5cc8be-43ae-40df-abb9-4781fab82eb0" released by "delete_snapshot" :: held 2.331s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:29 devstack sudo[86362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.info
Apr 28 02:20:29 devstack sudo[86362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:30 devstack cinder-volume[81489]: WARNING cinder.quota [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1124623804 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1124623804, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:20:30 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] Created reservations ['58ac3ba9-3130-42c6-832c-ec6acc4cd9c7', '77997e48-554b-401e-be14-e7a9752e0a6b', 'b07db704-3883-4048-8494-3658ee5c2cb4', '4f1f47a4-ebae-4497-a683-17940b3fac49'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:20:30 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-fe445e3f-fd21-442e-b882-0cf069667f5a tempest-GroupSnapshotsTest-1032638190 None] group_snapshot 35cf4da0-a160-496a-9918-e3c05594ae07: deleted successfully
Apr 28 02:20:30 devstack sudo[86362]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.info" returned: 0 in 0.522s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:30 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.info is being set with open permissions: ugo+rw
Apr 28 02:20:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:30 devstack sudo[86366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.info
Apr 28 02:20:30 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:30 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:30 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-8d5cc8be-43ae-40df-abb9-4781fab82eb0" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.info" returned: 0 in 0.493s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:30 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Acquiring lock "cinder-quobyte-34176868-d58e-48f6-b324-9cc6ec2c48dd" by "_copy_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:30 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-8d5cc8be-43ae-40df-abb9-4781fab82eb0" acquired by "delete_volume" :: waited 0.030s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Lock "cinder-quobyte-34176868-d58e-48f6-b324-9cc6ec2c48dd" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] snapshot: ec154ab9-6f36-429d-b491-de8ea4e029a9, volume: 34176868-d58e-48f6-b324-9cc6ec2c48dd,  {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75aa333-4e72-4500-ad22-219870583522]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7a4237-3320-4152-a476-5b1d3f9101eb]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:31 devstack sudo[86369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0
Apr 28 02:20:31 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:31 devstack sudo[86370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9
Apr 28 02:20:31 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:31 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0" returned: 0 in 0.689s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:31 devstack sudo[86391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0
Apr 28 02:20:31 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:31 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9" returned: 0 in 0.796s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Creating direct copy from snapshot {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e394e2e-7d6b-4200-9351-a32233c4dfca]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:31 devstack sudo[86412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3
Apr 28 02:20:31 devstack sudo[86412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:32 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8d5cc8be-43ae-40df-abb9-4781fab82eb0" returned: 0 in 0.539s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-8d5cc8be-43ae-40df-abb9-4781fab82eb0" released by "delete_volume" :: held 1.308s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:32 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Created reservations ['e1f75488-1519-43aa-b2cf-6d8b72477e5e'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:20:32 devstack cinder-volume[81489]: WARNING cinder.db.sqlalchemy.api [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1124623804']
Apr 28 02:20:32 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Created reservations ['e6310c73-d18d-47cc-9968-7b39fb991cea', 'fd208a79-9f66-4156-9c87-939c0ad6fdae', 'ff37d4e9-eaef-4b82-8111-f99c0b1261ff', 'd3a12ecb-431c-4c9f-9604-b1928073f27a'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:20:32 devstack sudo[86412]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3" returned: 0 in 0.630s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:32 devstack cinder-volume[81489]: DEBUG cinder.utils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Path /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd not found in is_blk_device check {{(pid=81489) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 02:20:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:32 devstack sudo[86419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd
Apr 28 02:20:32 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:32 devstack sudo[86421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:20:32 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:33 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.470s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:33 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:20:33 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f399364b-65de-455b-8011-afc337b4a9b4 tempest-GroupSnapshotsTest-1032638190 None] Delete group completed successfully.
Apr 28 02:20:34 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-75d9d7b4-0336-4396-b17b-0adf028b2c25 tempest-GroupSnapshotsTest-1032638190 None] Group tempest-GroupSnapshotsTest-Group-903120807: creating
Apr 28 02:20:34 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-75d9d7b4-0336-4396-b17b-0adf028b2c25 tempest-GroupSnapshotsTest-1032638190 None] Group tempest-GroupSnapshotsTest-Group-903120807: created successfully
Apr 28 02:20:34 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-75d9d7b4-0336-4396-b17b-0adf028b2c25 tempest-GroupSnapshotsTest-1032638190 None] Create group completed successfully.
Apr 28 02:20:36 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:20:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Flow 'volume_create_manager' (cfe43b3e-c927-4e9f-93c5-66cb968c5aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:20:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f72ce6-9eac-4ad7-9967-1f97cf2462a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f72ce6-9eac-4ad7-9967-1f97cf2462a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1801902317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1c4ed27-ec82-4980-8ba6-3a0d3978e06b,host='devstack@QuobyteHD#QuobyteHD',id=fe8197a0-4901-4082-8f59-20dbcd08dadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8768b3217159430b8961f17fa96f1886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:20:36Z,use_quota=True,user_id='b3ff9eae8a35418aa4fbf360a6c3bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(410d089d-1442-433d-a970-143ea35c633e),volume_type_id=410d089d-1442-433d-a970-143ea35c633e)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caa2e3d-e924-4c5a-9cf8-73908ae8c70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caa2e3d-e924-4c5a-9cf8-73908ae8c70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e154dd-d2a3-4545-b2f3-a6831d31d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e154dd-d2a3-4545-b2f3-a6831d31d273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe8197a0-4901-4082-8f59-20dbcd08dadc', 'volume_name': 'volume-fe8197a0-4901-4082-8f59-20dbcd08dadc', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93125299-eb94-416a-9ae4-0dbba14312af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93125299-eb94-416a-9ae4-0dbba14312af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b737ee3b-234f-464f-ad0c-00f0c546363b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:36 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Volume fe8197a0-4901-4082-8f59-20dbcd08dadc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe8197a0-4901-4082-8f59-20dbcd08dadc', 'volume_size': 1}
Apr 28 02:20:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:38 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd" returned: 0 in 5.500s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:38 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adee718-87c7-4691-95d6-1d2720c7448f]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:38 devstack sudo[86438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3
Apr 28 02:20:38 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:38 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3" returned: 0 in 0.720s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:38 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:20:38 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Converted 1024.00 MB image at 186.14 MB/s
Apr 28 02:20:38 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd is being set with open permissions: ugo+rw
Apr 28 02:20:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:38 devstack sudo[86443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd
Apr 28 02:20:38 devstack sudo[86443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:39 devstack sudo[86443]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd" returned: 0 in 0.502s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Lock "cinder-quobyte-34176868-d58e-48f6-b324-9cc6ec2c48dd" released by "_copy_volume_from_snapshot" :: held 8.235s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Acquiring lock "cinder-quobyte-ec154ab9-6f36-429d-b491-de8ea4e029a9" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Lock "cinder-quobyte-ec154ab9-6f36-429d-b491-de8ea4e029a9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Deleting offline snapshot ec154ab9-6f36-429d-b491-de8ea4e029a9 of volume 9e86164f-b9d9-4f21-9673-db94d0e09fc3 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:20:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] snapshot_file for this snap is: volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:20:39 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[975c913c-b951-4a58-af68-a1c03fbfaedf]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:39 devstack sudo[86447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9
Apr 28 02:20:39 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:39 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9" returned: 0 in 0.573s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:20:39 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3da654-7745-4ea2-9de7-b144620f2c2b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:40 devstack sudo[86452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3
Apr 28 02:20:40 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:40 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3" returned: 0 in 0.620s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:40 devstack sudo[86457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9
Apr 28 02:20:40 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:41 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9" returned: 0 in 0.624s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:41 devstack sudo[86463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9
Apr 28 02:20:41 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:41 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3.ec154ab9-6f36-429d-b491-de8ea4e029a9" returned: 0 in 0.529s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Lock "cinder-quobyte-ec154ab9-6f36-429d-b491-de8ea4e029a9" released by "_delete_snapshot" :: held 2.438s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.140s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.575s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a1c4ed27-ec82-4980-8ba6-3a0d3978e06b,created_at=2026-04-28T00:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1801902317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1c4ed27-ec82-4980-8ba6-3a0d3978e06b,host='devstack@QuobyteHD#QuobyteHD',id=fe8197a0-4901-4082-8f59-20dbcd08dadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8768b3217159430b8961f17fa96f1886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:20:36Z,use_quota=True,user_id='b3ff9eae8a35418aa4fbf360a6c3bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(410d089d-1442-433d-a970-143ea35c633e),volume_type_id=410d089d-1442-433d-a970-143ea35c633e)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Creating volume fe8197a0-4901-4082-8f59-20dbcd08dadc {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:20:41 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:41 devstack sudo[86466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc 1073741824
Apr 28 02:20:41 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedce58c-7921-4b3e-8819-b4abb381d006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34176868-d58e-48f6-b324-9cc6ec2c48dd', 'volume_size': 2, 'source_volid': '9e86164f-b9d9-4f21-9673-db94d0e09fc3', 'source_volstatus': 'available'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63236140-34af-476e-be69-7614441ce2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:41 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Volume volume-34176868-d58e-48f6-b324-9cc6ec2c48dd (34176868-d58e-48f6-b324-9cc6ec2c48dd): created successfully
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63236140-34af-476e-be69-7614441ce2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Flow 'volume_create_manager' (e7e9b752-4f24-4912-b34d-2be3de2957f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:20:41 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-4cfa9d19-998c-42fc-b525-7f571be40ad8 tempest-VolumesCloneTest-1189072738 None] Created volume successfully.
Apr 28 02:20:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Acquiring lock "cinder-34176868-d58e-48f6-b324-9cc6ec2c48dd-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Lock "cinder-34176868-d58e-48f6-b324-9cc6ec2c48dd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Acquiring lock "cinder-quobyte-34176868-d58e-48f6-b324-9cc6ec2c48dd" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Lock "cinder-quobyte-34176868-d58e-48f6-b324-9cc6ec2c48dd" acquired by "delete_volume" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:42 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[66046ca4-3d44-49bf-8a63-8103ab87ac81]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:42 devstack sudo[86470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd
Apr 28 02:20:42 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:42 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc 1073741824" returned: 0 in 0.725s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:42 devstack sudo[86473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc
Apr 28 02:20:42 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:42 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd" returned: 0 in 0.601s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:42 devstack sudo[86478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd
Apr 28 02:20:42 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:43 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc" returned: 0 in 0.509s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b737ee3b-234f-464f-ad0c-00f0c546363b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe8197a0-4901-4082-8f59-20dbcd08dadc', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df7d61b-df76-43d8-9389-e02c7461b766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:43 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Volume volume-fe8197a0-4901-4082-8f59-20dbcd08dadc (fe8197a0-4901-4082-8f59-20dbcd08dadc): created successfully
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df7d61b-df76-43d8-9389-e02c7461b766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Flow 'volume_create_manager' (cfe43b3e-c927-4e9f-93c5-66cb968c5aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:20:43 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-09137e5c-13c1-4534-8c39-88b561930cd9 tempest-GroupSnapshotsTest-1032638190 None] Created volume successfully.
Apr 28 02:20:43 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34176868-d58e-48f6-b324-9cc6ec2c48dd" returned: 0 in 0.533s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Lock "cinder-quobyte-34176868-d58e-48f6-b324-9cc6ec2c48dd" released by "delete_volume" :: held 1.168s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Created reservations ['5832da9e-23c2-4f27-bac0-3fcdc0aaf397', '12654a57-d7ea-43dd-bfc1-667599353824', '5c8ba30e-171f-419a-a406-7eceacaa0ade', '381f62e6-7cdf-4382-a44b-32c3a47eff70'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:43 devstack sudo[86482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:20:43 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:43 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.490s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:43 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:20:43 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Deleted volume successfully.
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6ddae8be-fa3a-49eb-a601-d7e66f2bdc0d tempest-VolumesCloneTest-1189072738 None] Lock "cinder-34176868-d58e-48f6-b324-9cc6ec2c48dd-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Flow 'volume_create_manager' (8bb34801-fe41-44a8-8451-ddd03c1c3e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3633b13-1900-4c43-abc5-49dbeaca1d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3633b13-1900-4c43-abc5-49dbeaca1d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-797120436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1c4ed27-ec82-4980-8ba6-3a0d3978e06b,host='devstack@QuobyteHD#QuobyteHD',id=f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8768b3217159430b8961f17fa96f1886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:20:44Z,use_quota=True,user_id='b3ff9eae8a35418aa4fbf360a6c3bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(410d089d-1442-433d-a970-143ea35c633e),volume_type_id=410d089d-1442-433d-a970-143ea35c633e)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ee1028-7c19-4fdc-9d74-69362a6be382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ee1028-7c19-4fdc-9d74-69362a6be382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acda043c-2c5e-448a-aefe-997b9a99890a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acda043c-2c5e-448a-aefe-997b9a99890a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c', 'volume_name': 'volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0470932a-fc9e-42d2-9c46-c301f8c54503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0470932a-fc9e-42d2-9c46-c301f8c54503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832425e7-c646-41a6-8a05-830d512f2806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:44 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Volume f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c', 'volume_size': 1}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a1c4ed27-ec82-4980-8ba6-3a0d3978e06b,created_at=2026-04-28T00:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-797120436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a1c4ed27-ec82-4980-8ba6-3a0d3978e06b,host='devstack@QuobyteHD#QuobyteHD',id=f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8768b3217159430b8961f17fa96f1886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:20:44Z,use_quota=True,user_id='b3ff9eae8a35418aa4fbf360a6c3bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(410d089d-1442-433d-a970-143ea35c633e),volume_type_id=410d089d-1442-433d-a970-143ea35c633e)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Creating volume f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:20:44 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Acquiring lock "cinder-9e86164f-b9d9-4f21-9673-db94d0e09fc3-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:44 devstack sudo[86485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c 1073741824
Apr 28 02:20:44 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Lock "cinder-9e86164f-b9d9-4f21-9673-db94d0e09fc3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Acquiring lock "cinder-quobyte-9e86164f-b9d9-4f21-9673-db94d0e09fc3" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Lock "cinder-quobyte-9e86164f-b9d9-4f21-9673-db94d0e09fc3" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea125b15-1ba9-4bc9-8891-03aefd00f7ba]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:44 devstack sudo[86487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3
Apr 28 02:20:44 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:45 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c 1073741824" returned: 0 in 0.665s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:45 devstack sudo[86495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c
Apr 28 02:20:45 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:45 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3" returned: 0 in 0.643s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:45 devstack sudo[86497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3
Apr 28 02:20:45 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:45 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c" returned: 0 in 0.545s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832425e7-c646-41a6-8a05-830d512f2806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9437c1-4208-40bc-8523-441dd22d92f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:45 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Volume volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c (f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c): created successfully
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9437c1-4208-40bc-8523-441dd22d92f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Flow 'volume_create_manager' (8bb34801-fe41-44a8-8451-ddd03c1c3e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:20:45 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-bb48af9d-34ef-49e5-a8b9-0b27c792538d tempest-GroupSnapshotsTest-1032638190 None] Created volume successfully.
Apr 28 02:20:45 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-9e86164f-b9d9-4f21-9673-db94d0e09fc3" returned: 0 in 0.559s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Lock "cinder-quobyte-9e86164f-b9d9-4f21-9673-db94d0e09fc3" released by "delete_volume" :: held 1.256s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Created reservations ['c1cb4852-095d-42e8-ae67-1ef6b4b3f740', '3af69306-2de3-4ad0-8f88-d0a071d0e70f', 'a59b332f-363c-4bf8-9881-cd784ee2ed88', '7eea1292-6f4a-4aa3-9e88-b5d4604ee96a'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:46 devstack sudo[86512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:20:46 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:46 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.491s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:46 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:20:46 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Deleted volume successfully.
Apr 28 02:20:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-141fbb61-bf7b-45ab-af3d-ea9a0e1fd40d tempest-VolumesCloneTest-1189072738 None] Lock "cinder-9e86164f-b9d9-4f21-9673-db94d0e09fc3-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:20:46 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-26376e80-f710-4ae7-a5e4-c023a2650fc0 tempest-GroupSnapshotsTest-1032638190 None] Update group completed successfully.
Apr 28 02:20:48 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-5646c57d-af08-4221-a2b3-b0d88bf6967c tempest-GroupSnapshotsTest-1032638190 None] Update group completed successfully.
Apr 28 02:20:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2b8ef786-13cb-4dd5-966b-de19963869c6 tempest-BackendsCapabilitiesAdminTestsJSON-2123693474 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732765197754, 'free_capacity_gb': 1775.732765197754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81489) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-85f2e3e9-7679-4830-8039-08a2305ce9db tempest-BackendsCapabilitiesAdminTestsJSON-2123693474 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732765197754, 'free_capacity_gb': 1775.732765197754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81489) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=81,cinder:INSERT=15,cinder:UPDATE=88,cinder:DELETE=4 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:UPDATE=83,cinder:DELETE=6,cinder:SELECT=76,cinder:INSERT=24 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (fcd5f633-e4f5-4a0e-8885-ab219107830c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73b1763-5233-448e-a6f8-f700f4c12956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:49 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ee37d9d0-a8e3-45e3-968a-86c19948e12f tempest-GroupSnapshotsTest-1032638190 None] Update group completed successfully.
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73b1763-5233-448e-a6f8-f700f4c12956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-503867530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1ad9b8-4f01-449a-925c-b401b3c7218b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89018e6ab95f4dc89ff92c9bd2f0eae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:20:49Z,use_quota=True,user_id='9f052c45255a4168bd86a2cb03ae96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218a07b0-4154-4263-b389-1bcac8d83e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218a07b0-4154-4263-b389-1bcac8d83e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e52c94-44f5-42b6-8a06-498fc375bc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e52c94-44f5-42b6-8a06-498fc375bc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec1ad9b8-4f01-449a-925c-b401b3c7218b', 'volume_name': 'volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba13008-7f0a-4b09-ace8-65793bfb5428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba13008-7f0a-4b09-ace8-65793bfb5428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72647a0e-1f50-48c5-9ce4-dd14962a0121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:49 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Volume ec1ad9b8-4f01-449a-925c-b401b3c7218b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b', 'volume_size': 1}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-503867530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1ad9b8-4f01-449a-925c-b401b3c7218b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89018e6ab95f4dc89ff92c9bd2f0eae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:20:49Z,use_quota=True,user_id='9f052c45255a4168bd86a2cb03ae96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Creating volume ec1ad9b8-4f01-449a-925c-b401b3c7218b {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:20:49 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:49 devstack sudo[86539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b 1073741824
Apr 28 02:20:49 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:49 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b 1073741824" returned: 0 in 0.646s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:49 devstack sudo[86544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b
Apr 28 02:20:49 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:50 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-515634f0-3a99-421c-8a6f-ba2ae0339928 tempest-GroupSnapshotsTest-1032638190 None] Update group completed successfully.
Apr 28 02:20:50 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b" returned: 0 in 0.533s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:20:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72647a0e-1f50-48c5-9ce4-dd14962a0121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35390b15-a266-4da1-9ea3-01d2dceef4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:50 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Volume volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b (ec1ad9b8-4f01-449a-925c-b401b3c7218b): created successfully
Apr 28 02:20:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35390b15-a266-4da1-9ea3-01d2dceef4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:50 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (fcd5f633-e4f5-4a0e-8885-ab219107830c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:20:50 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-e7665142-5dac-408b-9069-55fabf022767 tempest-VolumesGetTest-1305963099 None] Created volume successfully.
Apr 28 02:20:51 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] GroupSnapshot f074c512-486f-4012-9d85-bdbfae8f329d: creating.
Apr 28 02:20:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Group snapshot f074c512-486f-4012-9d85-bdbfae8f329d: creating. {{(pid=81489) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 28 02:20:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Creating offline snapshot ab03795b-ac52-4899-aead-553ae6caa29f of volume f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:20:51 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b784dd-cab2-4f6a-841a-0f1028d686f9]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:20:52 devstack sudo[86547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c
Apr 28 02:20:52 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (2a88ddf2-3866-480d-9361-886003085b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a6872c-a418-4ced-9923-f52b07c49ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a6872c-a418-4ced-9923-f52b07c49ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:20:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1165299287',display_name='tempest-VolumesGetTest-Volume-1891653211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b51d5e1-1640-41c1-a9f1-505d762e9243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89018e6ab95f4dc89ff92c9bd2f0eae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:20:52Z,use_quota=True,user_id='9f052c45255a4168bd86a2cb03ae96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4071f9-15df-43fc-9775-e2129b53e448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4071f9-15df-43fc-9775-e2129b53e448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e087a13d-90aa-4e62-b83a-082c00f3c978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e087a13d-90aa-4e62-b83a-082c00f3c978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b51d5e1-1640-41c1-a9f1-505d762e9243', 'volume_name': 'volume-8b51d5e1-1640-41c1-a9f1-505d762e9243', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3cb1716-df9a-4870-bd3f-956924ee4f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3cb1716-df9a-4870-bd3f-956924ee4f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847bd5b4-813f-4223-acca-8e05b84666db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:52 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Volume 8b51d5e1-1640-41c1-a9f1-505d762e9243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b51d5e1-1640-41c1-a9f1-505d762e9243', 'volume_size': 1}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:52 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c" returned: 0 in 0.582s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:52 devstack sudo[86552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f 1G
Apr 28 02:20:52 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:52 devstack sudo[86554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:20:52 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:53 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.541s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:20:53 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f 1G" returned: 0 in 0.702s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:53 devstack sudo[86560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f
Apr 28 02:20:53 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:53 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f" returned: 0 in 0.530s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:53 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:20:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:53 devstack sudo[86565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f
Apr 28 02:20:53 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:53 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8a608cbd-c308-47fb-88dd-b44d5c92c295 tempest-GroupsV320Test-1652827589 None] Group tempest-GroupsV320Test-Group-298734609: creating
Apr 28 02:20:54 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8a608cbd-c308-47fb-88dd-b44d5c92c295 tempest-GroupsV320Test-1652827589 None] Group tempest-GroupsV320Test-Group-298734609: created successfully
Apr 28 02:20:54 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8a608cbd-c308-47fb-88dd-b44d5c92c295 tempest-GroupsV320Test-1652827589 None] Create group completed successfully.
Apr 28 02:20:54 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f" returned: 0 in 0.473s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:54 devstack sudo[86568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.info
Apr 28 02:20:54 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:54 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.info" returned: 0 in 0.450s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:54 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:20:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:54 devstack sudo[86571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.info
Apr 28 02:20:54 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:55 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.info" returned: 0 in 0.458s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.293s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Creating offline snapshot fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253 of volume fe8197a0-4901-4082-8f59-20dbcd08dadc {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c047b313-7b7d-45eb-b977-27356f966eec]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:55 devstack sudo[86574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc
Apr 28 02:20:55 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-817a4446-251f-4f39-892e-b86d26ecb179 tempest-GroupsV320Test-1652827589 None] Created reservations ['ff97a478-a7ca-40c9-a8c0-fcb85adef8d9'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-817a4446-251f-4f39-892e-b86d26ecb179 tempest-GroupsV320Test-1652827589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-817a4446-251f-4f39-892e-b86d26ecb179 tempest-GroupsV320Test-1652827589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-817a4446-251f-4f39-892e-b86d26ecb179 tempest-GroupsV320Test-1652827589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-817a4446-251f-4f39-892e-b86d26ecb179 tempest-GroupsV320Test-1652827589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-817a4446-251f-4f39-892e-b86d26ecb179 tempest-GroupsV320Test-1652827589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-817a4446-251f-4f39-892e-b86d26ecb179 tempest-GroupsV320Test-1652827589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:55 devstack sudo[86576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:20:55 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:55 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc" returned: 0 in 0.567s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:55 devstack sudo[86581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253 1G
Apr 28 02:20:55 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:56 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-817a4446-251f-4f39-892e-b86d26ecb179 tempest-GroupsV320Test-1652827589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.477s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:56 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-817a4446-251f-4f39-892e-b86d26ecb179 tempest-GroupsV320Test-1652827589 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:20:56 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-817a4446-251f-4f39-892e-b86d26ecb179 tempest-GroupsV320Test-1652827589 None] Delete group completed successfully.
Apr 28 02:20:56 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253 1G" returned: 0 in 0.585s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe8197a0-4901-4082-8f59-20dbcd08dadc -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:56 devstack sudo[86587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe8197a0-4901-4082-8f59-20dbcd08dadc -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253
Apr 28 02:20:56 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:56 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe8197a0-4901-4082-8f59-20dbcd08dadc -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253" returned: 0 in 0.511s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:56 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253 is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:20:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:56 devstack sudo[86592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253
Apr 28 02:20:56 devstack sudo[86592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:57 devstack sudo[86592]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253" returned: 0 in 0.483s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:57 devstack sudo[86596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.info
Apr 28 02:20:57 devstack sudo[86596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:57 devstack sudo[86596]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.info" returned: 0 in 0.515s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:57 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:20:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:57 devstack sudo[86599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.info
Apr 28 02:20:57 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:58 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.info" returned: 0 in 0.512s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.276s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.390s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:20:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1165299287',display_name='tempest-VolumesGetTest-Volume-1891653211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b51d5e1-1640-41c1-a9f1-505d762e9243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89018e6ab95f4dc89ff92c9bd2f0eae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:20:52Z,use_quota=True,user_id='9f052c45255a4168bd86a2cb03ae96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:20:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Creating volume 8b51d5e1-1640-41c1-a9f1-505d762e9243 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:20:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:20:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:20:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:20:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:20:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:20:58 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:20:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b51d5e1-1640-41c1-a9f1-505d762e9243 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:58 devstack sudo[86602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b51d5e1-1640-41c1-a9f1-505d762e9243 1073741824
Apr 28 02:20:58 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:58 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-9a0200b7-fa96-4329-9031-db4a4a636150 tempest-GroupSnapshotsTest-1032638190 None] group_snapshot f074c512-486f-4012-9d85-bdbfae8f329d: created successfully
Apr 28 02:20:59 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b51d5e1-1640-41c1-a9f1-505d762e9243 1073741824" returned: 0 in 0.705s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b51d5e1-1640-41c1-a9f1-505d762e9243 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:59 devstack sudo[86607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b51d5e1-1640-41c1-a9f1-505d762e9243
Apr 28 02:20:59 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:59 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] group_snapshot f074c512-486f-4012-9d85-bdbfae8f329d: deleting
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] group_snapshot f074c512-486f-4012-9d85-bdbfae8f329d: deleting {{(pid=81489) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-ab03795b-ac52-4899-aead-553ae6caa29f" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-ab03795b-ac52-4899-aead-553ae6caa29f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Deleting offline snapshot ab03795b-ac52-4899-aead-553ae6caa29f of volume f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] snapshot_file for this snap is: volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[83caa365-43e8-4342-9d97-8329ccbbcbb7]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:20:59 devstack sudo[86609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f
Apr 28 02:20:59 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:20:59 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b51d5e1-1640-41c1-a9f1-505d762e9243" returned: 0 in 0.567s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847bd5b4-813f-4223-acca-8e05b84666db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b51d5e1-1640-41c1-a9f1-505d762e9243', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f4cb78-8bc0-4301-9388-e476e29283b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:20:59 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Volume volume-8b51d5e1-1640-41c1-a9f1-505d762e9243 (8b51d5e1-1640-41c1-a9f1-505d762e9243): created successfully
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f4cb78-8bc0-4301-9388-e476e29283b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:20:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (2a88ddf2-3866-480d-9361-886003085b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:20:59 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-08d7db4e-8755-4666-ab15-77b07c01e972 tempest-VolumesGetTest-1305963099 None] Created volume successfully.
Apr 28 02:21:00 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f" returned: 0 in 0.568s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:00 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:00 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[537841f3-8f4d-46d5-a068-297af5d51161]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:00 devstack sudo[86615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c
Apr 28 02:21:00 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:00 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c" returned: 0 in 0.573s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:00 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-8b51d5e1-1640-41c1-a9f1-505d762e9243-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:00 devstack sudo[86620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f
Apr 28 02:21:00 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:00 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Lock "cinder-8b51d5e1-1640-41c1-a9f1-505d762e9243-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:00 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-quobyte-8b51d5e1-1640-41c1-a9f1-505d762e9243" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:00 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-8b51d5e1-1640-41c1-a9f1-505d762e9243" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:00 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91b3202-07a2-41a5-8e92-28a614a92404]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b51d5e1-1640-41c1-a9f1-505d762e9243 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:00 devstack sudo[86622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b51d5e1-1640-41c1-a9f1-505d762e9243
Apr 28 02:21:00 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:01 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f" returned: 0 in 0.666s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:01 devstack sudo[86630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f
Apr 28 02:21:01 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:01 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b51d5e1-1640-41c1-a9f1-505d762e9243" returned: 0 in 0.629s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b51d5e1-1640-41c1-a9f1-505d762e9243 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:01 devstack sudo[86632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b51d5e1-1640-41c1-a9f1-505d762e9243
Apr 28 02:21:01 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:01 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c.ab03795b-ac52-4899-aead-553ae6caa29f" returned: 0 in 0.456s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-ab03795b-ac52-4899-aead-553ae6caa29f" released by "_delete_snapshot" :: held 2.402s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c" released by "delete_snapshot" :: held 2.433s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-fe8197a0-4901-4082-8f59-20dbcd08dadc" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-fe8197a0-4901-4082-8f59-20dbcd08dadc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Deleting offline snapshot fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253 of volume fe8197a0-4901-4082-8f59-20dbcd08dadc {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] snapshot_file for this snap is: volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5306a5f7-3013-4756-95c0-350561aa764e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:02 devstack sudo[86636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253
Apr 28 02:21:02 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:02 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8b51d5e1-1640-41c1-a9f1-505d762e9243" returned: 0 in 0.586s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-8b51d5e1-1640-41c1-a9f1-505d762e9243" released by "delete_volume" :: held 1.266s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Created reservations ['20d79fd1-bb58-4238-9ae1-5d80959e7984', 'e02100af-23da-46c2-82c8-e8a35e90d2fc', 'b32b79ee-188b-411c-82fa-2d7391a3a5f5', 'd043f3ab-944e-4a73-8535-a0a57aabd4ab'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:02 devstack sudo[86638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:21:02 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:02 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253" returned: 0 in 0.559s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe8197a0-4901-4082-8f59-20dbcd08dadc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[29deb502-a961-4457-9235-654fbd373317]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:02 devstack sudo[86643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc
Apr 28 02:21:02 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:02 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.505s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:21:02 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Deleted volume successfully.
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87c9e84e-ba33-420b-8288-a51739f4ed97 tempest-VolumesGetTest-1305963099 None] Lock "cinder-8b51d5e1-1640-41c1-a9f1-505d762e9243-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-ec1ad9b8-4f01-449a-925c-b401b3c7218b-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Lock "cinder-ec1ad9b8-4f01-449a-925c-b401b3c7218b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:03 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-quobyte-ec1ad9b8-4f01-449a-925c-b401b3c7218b" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:03 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-ec1ad9b8-4f01-449a-925c-b401b3c7218b" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:03 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e50b75b-1f9a-4661-966d-395013b6ad41]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:03 devstack sudo[86648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b
Apr 28 02:21:03 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:03 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc" returned: 0 in 0.642s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:03 devstack sudo[86651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253
Apr 28 02:21:03 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:03 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b" returned: 0 in 0.602s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:03 devstack sudo[86659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b
Apr 28 02:21:03 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:03 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253" returned: 0 in 0.620s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:03 devstack sudo[86661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253
Apr 28 02:21:03 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:04 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ec1ad9b8-4f01-449a-925c-b401b3c7218b" returned: 0 in 0.513s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-ec1ad9b8-4f01-449a-925c-b401b3c7218b" released by "delete_volume" :: held 1.172s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Created reservations ['827373d8-e4da-4157-b7b8-b87eff2b32d0', '82904620-2e3b-4ef4-b576-8db0318a4066', 'a51cd68b-0b63-4279-ad2a-32015764848b', 'd77c8fa9-36fe-44e1-9eb3-c7aedc9012e9'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:04 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc.fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253" returned: 0 in 0.561s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:04 devstack sudo[86665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:21:04 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-fa31b5d8-6c2c-4ff8-b8c5-cf9bf6ac5253" released by "_delete_snapshot" :: held 2.489s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-fe8197a0-4901-4082-8f59-20dbcd08dadc" released by "delete_snapshot" :: held 2.515s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:04 devstack cinder-volume[81489]: WARNING cinder.quota [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1706998674 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1706998674, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:21:04 devstack cinder-volume[81489]: WARNING cinder.quota [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1706998674 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1706998674, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Created reservations ['4decd474-1e22-478f-a0d6-b2f34c3f55a1', '73042e61-5b9a-47b6-91e0-beb9af9590be', '2650c63e-8d81-4aea-a54b-e8afba5a0d37', 'e48a8a0c-dd11-4434-bb2a-0677c1388883'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] Created reservations ['645732b0-a205-41de-a99c-6c9dfa126048', 'a179d4ae-dd55-4d57-b149-bb4e47a9a886', '444f2b95-1fb7-4b0d-b4fd-5e1d26d2c4fe', 'aa33688d-efa2-45e2-9819-0cb325c6b45d'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:04 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ab20fc15-8b41-4710-a89e-25446d2a5e54 tempest-GroupSnapshotsTest-1032638190 None] group_snapshot f074c512-486f-4012-9d85-bdbfae8f329d: deleted successfully
Apr 28 02:21:04 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.529s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:21:04 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Deleted volume successfully.
Apr 28 02:21:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6be065d0-3fed-45fa-96e2-409bac132f4e tempest-VolumesGetTest-1305963099 None] Lock "cinder-ec1ad9b8-4f01-449a-925c-b401b3c7218b-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c37ec2-e0ae-48aa-8d8c-7289ba515946]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:05 devstack sudo[86668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c
Apr 28 02:21:05 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (523b9318-18b1-4905-9109-85c634b888c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c8da40-0d18-4727-ab25-e98ddff0a075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c8da40-0d18-4727-ab25-e98ddff0a075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-515010689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32573655-259c-46ff-a243-2624a5f8218e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89018e6ab95f4dc89ff92c9bd2f0eae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:06Z,use_quota=True,user_id='9f052c45255a4168bd86a2cb03ae96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56520b9b-4a94-4191-bea1-84163493518b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56520b9b-4a94-4191-bea1-84163493518b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be0a8c6-2dc5-4e76-89fb-72f9e79e6d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be0a8c6-2dc5-4e76-89fb-72f9e79e6d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32573655-259c-46ff-a243-2624a5f8218e', 'volume_name': 'volume-32573655-259c-46ff-a243-2624a5f8218e', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811f9438-29f0-413a-bf76-1be91109662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811f9438-29f0-413a-bf76-1be91109662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a20839-d5b2-4ba9-b368-d1bd10574085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:05 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Volume 32573655-259c-46ff-a243-2624a5f8218e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32573655-259c-46ff-a243-2624a5f8218e', 'volume_size': 1}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-515010689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32573655-259c-46ff-a243-2624a5f8218e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89018e6ab95f4dc89ff92c9bd2f0eae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:06Z,use_quota=True,user_id='9f052c45255a4168bd86a2cb03ae96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Creating volume 32573655-259c-46ff-a243-2624a5f8218e {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:21:05 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:05 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c" returned: 0 in 0.613s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:05 devstack sudo[86673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e 1073741824
Apr 28 02:21:05 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:05 devstack sudo[86675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c
Apr 28 02:21:05 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:06 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c" returned: 0 in 0.520s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-f52ba2f6-4a05-43d8-9a1c-66b8eac71b0c" released by "delete_volume" :: held 1.205s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-fe8197a0-4901-4082-8f59-20dbcd08dadc" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-fe8197a0-4901-4082-8f59-20dbcd08dadc" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:06 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e5d8b9-3818-48d2-8fa1-39488f60fd4b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:06 devstack sudo[86681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc
Apr 28 02:21:06 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:06 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e 1073741824" returned: 0 in 0.742s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:06 devstack sudo[86683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e
Apr 28 02:21:06 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:06 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc" returned: 0 in 0.614s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:06 devstack sudo[86689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc
Apr 28 02:21:06 devstack sudo[86689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:06 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e" returned: 0 in 0.497s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:06 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:21:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a20839-d5b2-4ba9-b368-d1bd10574085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32573655-259c-46ff-a243-2624a5f8218e', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c95c167-b9ae-4e51-ad24-f7e651eb820e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:07 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Volume volume-32573655-259c-46ff-a243-2624a5f8218e (32573655-259c-46ff-a243-2624a5f8218e): created successfully
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c95c167-b9ae-4e51-ad24-f7e651eb820e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (523b9318-18b1-4905-9109-85c634b888c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:07 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3a8be3c3-3ac4-4e75-ae6d-3cb554a54085 tempest-VolumesGetTest-1305963099 None] Created volume successfully.
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Flow 'volume_create_manager' (209509f5-b122-446c-a20a-38d8a638958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bb6157-7ee5-4603-90d1-8266e4ae2d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bb6157-7ee5-4603-90d1-8266e4ae2d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1789238563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd014e0-f94d-42d3-aa92-f7443ececebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cbc6ab5f7451992795e4c20a60878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:07Z,use_quota=True,user_id='98acf4aef297401cb686e07e4e424179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0172f151-706d-4a9f-82fd-8e4cbdfe0a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0172f151-706d-4a9f-82fd-8e4cbdfe0a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc274f56-78a1-4bc8-a21c-8a7b92621fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc274f56-78a1-4bc8-a21c-8a7b92621fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abd014e0-f94d-42d3-aa92-f7443ececebd', 'volume_name': 'volume-abd014e0-f94d-42d3-aa92-f7443ececebd', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410ee725-6bdb-4b8c-8880-cd28ac764745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410ee725-6bdb-4b8c-8880-cd28ac764745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a476c7d-f6e6-4a74-ac50-7f832eda98c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:07 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Volume abd014e0-f94d-42d3-aa92-f7443ececebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abd014e0-f94d-42d3-aa92-f7443ececebd', 'volume_size': 1}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1789238563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd014e0-f94d-42d3-aa92-f7443ececebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd1cbc6ab5f7451992795e4c20a60878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:07Z,use_quota=True,user_id='98acf4aef297401cb686e07e4e424179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Creating volume abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:21:07 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:07 devstack sudo[86692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd 1073741824
Apr 28 02:21:07 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:07 devstack sudo[86689]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fe8197a0-4901-4082-8f59-20dbcd08dadc" returned: 0 in 0.525s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-fe8197a0-4901-4082-8f59-20dbcd08dadc" released by "delete_volume" :: held 1.200s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Created reservations ['4c4e9c45-c070-4acf-b2cb-0f298d2cfb8a'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:07 devstack cinder-volume[81489]: WARNING cinder.quota [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1706998674 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1706998674, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Created reservations ['6a0c36e3-71f1-4940-a6a0-f465ec2449a5', '67ee3d74-ddc9-4c00-b9ce-a6337e4968a7', '9b164d1a-1e21-48d6-a20c-52a55e9f944b', '2af18f81-a9f8-4cae-8389-1e2de47b2468'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Created reservations ['3898d1b2-f95e-4895-9f6c-37fd0c7dc37e', '7866f6c3-a49d-4dc6-a7e0-d43a7e817476', 'fc135807-95aa-4127-8283-8c98794aa42d', '677a6460-9b8a-40e3-8ad3-03945b17761b'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:07 devstack sudo[86698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:21:07 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:07 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd 1073741824" returned: 0 in 0.685s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:08 devstack sudo[86700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd
Apr 28 02:21:08 devstack sudo[86700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (0df1f2f8-3eaf-4abf-8b15-40120950dbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0299b61b-c45e-4da2-a2ad-da01834ae956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0299b61b-c45e-4da2-a2ad-da01834ae956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1791341823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89018e6ab95f4dc89ff92c9bd2f0eae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=32573655-259c-46ff-a243-2624a5f8218e,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:08Z,use_quota=True,user_id='9f052c45255a4168bd86a2cb03ae96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ec0514-e9e0-49e3-90e4-d61282344e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ec0514-e9e0-49e3-90e4-d61282344e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f097aa-6787-4749-88d5-e240a005ebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f097aa-6787-4749-88d5-e240a005ebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4', 'volume_name': 'volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4', 'volume_size': 1, 'source_volid': '32573655-259c-46ff-a243-2624a5f8218e', 'source_volstatus': 'available'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5156ac33-95ab-4b5d-b1ff-93ec088c46b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5156ac33-95ab-4b5d-b1ff-93ec088c46b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfeddf3e-9f7e-4b2a-aa54-b7b750dc8e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:08 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Volume e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4', 'volume_size': 1, 'source_volid': '32573655-259c-46ff-a243-2624a5f8218e', 'source_volstatus': 'available'}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:08 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.513s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:21:08 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-678fd048-9b7f-49f6-b87b-1e284a2a0589 tempest-GroupSnapshotsTest-1032638190 None] Delete group completed successfully.
Apr 28 02:21:08 devstack sudo[86700]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd" returned: 0 in 0.526s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.282s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:08 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Cloning volume 32573655-259c-46ff-a243-2624a5f8218e to volume e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a476c7d-f6e6-4a74-ac50-7f832eda98c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd014e0-f94d-42d3-aa92-f7443ececebd', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d420e065-7faf-488d-a599-87713f23db1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:08 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Volume volume-abd014e0-f94d-42d3-aa92-f7443ececebd (abd014e0-f94d-42d3-aa92-f7443ececebd): created successfully
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d420e065-7faf-488d-a599-87713f23db1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Flow 'volume_create_manager' (209509f5-b122-446c-a20a-38d8a638958c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Creating offline snapshot abe2ec8d-b537-40a6-b66a-cdbfb30e382a of volume 32573655-259c-46ff-a243-2624a5f8218e {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:21:08 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-1c9a514a-b2b8-4872-8ccf-5626c8f6b7ad tempest-SnapshotsActionsTest-195656230 None] Created volume successfully.
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0003a0c0-302e-417d-953d-ce276bd369ea]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:08 devstack sudo[86704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e
Apr 28 02:21:08 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:08 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3b9b555a-e4c4-4a97-a9fe-7c6986c10d9e tempest-GroupSnapshotsTest-1032638190 None] Group tempest-GroupSnapshotsTest-Group-920503016: creating
Apr 28 02:21:08 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3b9b555a-e4c4-4a97-a9fe-7c6986c10d9e tempest-GroupSnapshotsTest-1032638190 None] Group tempest-GroupSnapshotsTest-Group-920503016: created successfully
Apr 28 02:21:08 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3b9b555a-e4c4-4a97-a9fe-7c6986c10d9e tempest-GroupSnapshotsTest-1032638190 None] Create group completed successfully.
Apr 28 02:21:09 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e" returned: 0 in 0.528s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:09 devstack sudo[86709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a 1G
Apr 28 02:21:09 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:09 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a 1G" returned: 0 in 0.645s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32573655-259c-46ff-a243-2624a5f8218e -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:09 devstack sudo[86714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32573655-259c-46ff-a243-2624a5f8218e -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a
Apr 28 02:21:09 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Flow 'volume_create_manager' (228a931d-9ef1-4df3-b624-f195ca2db547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3a1ebb-9b72-485c-aabb-8b12ab07c1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3a1ebb-9b72-485c-aabb-8b12ab07c1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-112500597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fef43253-69c7-4370-92ad-22966f79204d,host='devstack@QuobyteHD#QuobyteHD',id=5ecca10e-33f5-4fc7-afcc-63307d9c3d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8768b3217159430b8961f17fa96f1886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:10Z,use_quota=True,user_id='b3ff9eae8a35418aa4fbf360a6c3bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53f133c1-dba2-4b68-a93c-859fa2807557),volume_type_id=53f133c1-dba2-4b68-a93c-859fa2807557)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9dcab4-62b1-4966-abb5-1ee2bbec59f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9dcab4-62b1-4966-abb5-1ee2bbec59f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c5f22c-e1ea-4810-8cd7-fd0275db113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c5f22c-e1ea-4810-8cd7-fd0275db113d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ecca10e-33f5-4fc7-afcc-63307d9c3d8f', 'volume_name': 'volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7acfdcb-313f-4afd-94d0-449f550015ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7acfdcb-313f-4afd-94d0-449f550015ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb903f5-6478-4dd6-b418-5741af8d96f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:10 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Volume 5ecca10e-33f5-4fc7-afcc-63307d9c3d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f', 'volume_size': 1}
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:10 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32573655-259c-46ff-a243-2624a5f8218e -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a" returned: 0 in 0.530s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:10 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a is being set with open permissions: ugo+rw
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:10 devstack sudo[86719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a
Apr 28 02:21:10 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:10 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a" returned: 0 in 0.463s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:10 devstack sudo[86722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.info
Apr 28 02:21:10 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:11 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.info" returned: 0 in 0.438s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:11 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.info is being set with open permissions: ugo+rw
Apr 28 02:21:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:11 devstack sudo[86725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.info
Apr 28 02:21:11 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:11 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.info" returned: 0 in 0.431s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:11 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-quobyte-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4" by "_copy_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:11 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] snapshot: abe2ec8d-b537-40a6-b66a-cdbfb30e382a, volume: e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4,  {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 02:21:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:11 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac17fe8e-67b5-418e-a70f-aceb51d5b179]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:11 devstack sudo[86728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a
Apr 28 02:21:11 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:12 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a" returned: 0 in 0.508s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32573655-259c-46ff-a243-2624a5f8218e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 02:21:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Creating direct copy from snapshot {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 02:21:12 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11f149a-7b20-42e9-889e-f5b663b34395]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:12 devstack sudo[86733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e
Apr 28 02:21:12 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:12 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e" returned: 0 in 0.520s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:12 devstack cinder-volume[81489]: DEBUG cinder.utils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Path /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4 not found in is_blk_device check {{(pid=81489) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 02:21:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:12 devstack sudo[86738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4
Apr 28 02:21:12 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:17 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4" returned: 0 in 4.582s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:17 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9242b6ac-4d10-4648-99f4-355d489eedd1]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:17 devstack sudo[86751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e
Apr 28 02:21:17 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:18 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e" returned: 0 in 0.669s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:18 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e, size 1024.00 MB, duration 4.58 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4 {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:21:18 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Converted 1024.00 MB image at 223.40 MB/s
Apr 28 02:21:18 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4 is being set with open permissions: ugo+rw
Apr 28 02:21:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:18 devstack sudo[86756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4
Apr 28 02:21:18 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:18 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4" returned: 0 in 0.442s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4" released by "_copy_volume_from_snapshot" :: held 6.793s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-quobyte-abe2ec8d-b537-40a6-b66a-cdbfb30e382a" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-abe2ec8d-b537-40a6-b66a-cdbfb30e382a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Deleting offline snapshot abe2ec8d-b537-40a6-b66a-cdbfb30e382a of volume 32573655-259c-46ff-a243-2624a5f8218e {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:21:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] snapshot_file for this snap is: volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:21:18 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5251f6-f7b6-4e7c-891a-9f3266060d0d]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:18 devstack sudo[86760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a
Apr 28 02:21:18 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:19 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a" returned: 0 in 0.549s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32573655-259c-46ff-a243-2624a5f8218e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:19 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e7ddea-5516-417f-852f-4f3875a1601f]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:19 devstack sudo[86766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e
Apr 28 02:21:19 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:19 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e" returned: 0 in 0.509s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:19 devstack sudo[86771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a
Apr 28 02:21:19 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:20 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a" returned: 0 in 0.571s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:20 devstack sudo[86776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a
Apr 28 02:21:20 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:20 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e.abe2ec8d-b537-40a6-b66a-cdbfb30e382a" returned: 0 in 0.440s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-abe2ec8d-b537-40a6-b66a-cdbfb30e382a" released by "_delete_snapshot" :: held 2.162s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.191s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.230s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfeddf3e-9f7e-4b2a-aa54-b7b750dc8e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4', 'volume_size': 1, 'source_volid': '32573655-259c-46ff-a243-2624a5f8218e', 'source_volstatus': 'available'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0155da-37a2-4a0b-aa23-54c9575d9aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] Creating offline snapshot 4f5a89a8-a798-469b-acd5-36bfaf5afe91 of volume abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:21:20 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Volume volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4 (e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4): created successfully
Apr 28 02:21:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0155da-37a2-4a0b-aa23-54c9575d9aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (0df1f2f8-3eaf-4abf-8b15-40120950dbd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:20 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb8b870-2182-4889-a64f-bc3e518af77d]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:20 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-90a1058c-ed69-427c-9042-3d28902ca85b tempest-VolumesGetTest-1305963099 None] Created volume successfully.
Apr 28 02:21:20 devstack sudo[86779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd
Apr 28 02:21:20 devstack sudo[86779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:21 devstack sudo[86779]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd" returned: 0 in 0.540s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:21 devstack sudo[86790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 1G
Apr 28 02:21:21 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:21 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:21:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (45e4ef5b-6e83-4782-bb5c-b8e8fa964af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a67031-0b40-4da3-86bd-d90d9d1324fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a67031-0b40-4da3-86bd-d90d9d1324fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-903683449',display_name='tempest-VolumesGetTest-Volume-1447581900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72265ef8-19b9-4749-a852-4056c7d3506f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89018e6ab95f4dc89ff92c9bd2f0eae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:22Z,use_quota=True,user_id='9f052c45255a4168bd86a2cb03ae96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1c7eee-7f93-4470-a8b8-687e68d1a61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1c7eee-7f93-4470-a8b8-687e68d1a61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80069111-12c5-4af8-b3ea-4179fbf640c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80069111-12c5-4af8-b3ea-4179fbf640c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72265ef8-19b9-4749-a852-4056c7d3506f', 'volume_name': 'volume-72265ef8-19b9-4749-a852-4056c7d3506f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818e93ba-59af-4e72-be13-cd9daa34705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818e93ba-59af-4e72-be13-cd9daa34705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6637b963-e69f-4f8b-8ffc-4daf0ccae00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:22 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:22 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Volume 72265ef8-19b9-4749-a852-4056c7d3506f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72265ef8-19b9-4749-a852-4056c7d3506f', 'volume_size': 1}
Apr 28 02:21:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 1G" returned: 0 in 0.670s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:22 devstack sudo[86795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91
Apr 28 02:21:22 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:22 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91" returned: 0 in 0.494s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:22 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 is being set with open permissions: ugo+rw
Apr 28 02:21:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:22 devstack sudo[86800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91
Apr 28 02:21:22 devstack sudo[86800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:22 devstack sudo[86800]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91" returned: 0 in 0.445s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:23 devstack sudo[86803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.info
Apr 28 02:21:23 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:23 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.info" returned: 0 in 0.453s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:23 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.info is being set with open permissions: ugo+rw
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:23 devstack sudo[86806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.info
Apr 28 02:21:23 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:23 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.info" returned: 0 in 0.431s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.143s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.600s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fef43253-69c7-4370-92ad-22966f79204d,created_at=2026-04-28T00:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-112500597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fef43253-69c7-4370-92ad-22966f79204d,host='devstack@QuobyteHD#QuobyteHD',id=5ecca10e-33f5-4fc7-afcc-63307d9c3d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8768b3217159430b8961f17fa96f1886',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:10Z,use_quota=True,user_id='b3ff9eae8a35418aa4fbf360a6c3bdb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53f133c1-dba2-4b68-a93c-859fa2807557),volume_type_id=53f133c1-dba2-4b68-a93c-859fa2807557)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Creating volume 5ecca10e-33f5-4fc7-afcc-63307d9c3d8f {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:21:23 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:21:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:23 devstack sudo[86809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f 1073741824
Apr 28 02:21:23 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:23 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-39e4bb46-ef69-46cc-9d32-73e0b4864359 tempest-SnapshotsActionsTest-195656230 None] Create snapshot completed successfully
Apr 28 02:21:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:24 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f 1073741824" returned: 0 in 0.667s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:24 devstack sudo[86814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f
Apr 28 02:21:24 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:25 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f" returned: 0 in 0.435s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.032s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-903683449',display_name='tempest-VolumesGetTest-Volume-1447581900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72265ef8-19b9-4749-a852-4056c7d3506f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89018e6ab95f4dc89ff92c9bd2f0eae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:22Z,use_quota=True,user_id='9f052c45255a4168bd86a2cb03ae96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Creating volume 72265ef8-19b9-4749-a852-4056c7d3506f {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:21:25 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-72265ef8-19b9-4749-a852-4056c7d3506f 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb903f5-6478-4dd6-b418-5741af8d96f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:25 devstack sudo[86817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-72265ef8-19b9-4749-a852-4056c7d3506f 1073741824
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99171bae-f086-4148-9586-aee8fafa0f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:25 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:25 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Volume volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f (5ecca10e-33f5-4fc7-afcc-63307d9c3d8f): created successfully
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99171bae-f086-4148-9586-aee8fafa0f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Flow 'volume_create_manager' (228a931d-9ef1-4df3-b624-f195ca2db547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:25 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-1b88f371-2ad0-4bcc-844c-5ad8d66688d1 tempest-GroupSnapshotsTest-1032638190 None] Created volume successfully.
Apr 28 02:21:25 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-72265ef8-19b9-4749-a852-4056c7d3506f 1073741824" returned: 0 in 0.610s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-72265ef8-19b9-4749-a852-4056c7d3506f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:25 devstack sudo[86822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-72265ef8-19b9-4749-a852-4056c7d3506f
Apr 28 02:21:25 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:25 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] GroupSnapshot cd00e76f-2032-4343-84a9-7609a93c69d8: creating.
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] Group snapshot cd00e76f-2032-4343-84a9-7609a93c69d8: creating. {{(pid=81489) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 28 02:21:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:26 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-72265ef8-19b9-4749-a852-4056c7d3506f" returned: 0 in 0.460s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.669s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6637b963-e69f-4f8b-8ffc-4daf0ccae00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72265ef8-19b9-4749-a852-4056c7d3506f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4066b6c2-f336-496f-acf5-6c60bd72988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:26 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Volume volume-72265ef8-19b9-4749-a852-4056c7d3506f (72265ef8-19b9-4749-a852-4056c7d3506f): created successfully
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4066b6c2-f336-496f-acf5-6c60bd72988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (45e4ef5b-6e83-4782-bb5c-b8e8fa964af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] Creating offline snapshot a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3 of volume abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9555d28d-e55a-4884-a5b5-423185c114d3]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:26 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-63592abb-decd-43e9-9be4-8c51f2f8fe06 tempest-VolumesGetTest-1305963099 None] Created volume successfully.
Apr 28 02:21:26 devstack sudo[86825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91
Apr 28 02:21:26 devstack sudo[86825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:26 devstack sudo[86825]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91" returned: 0 in 0.526s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd014e0-f94d-42d3-aa92-f7443ececebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:26 devstack sudo[86830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3 1G
Apr 28 02:21:26 devstack sudo[86830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-72265ef8-19b9-4749-a852-4056c7d3506f-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Lock "cinder-72265ef8-19b9-4749-a852-4056c7d3506f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-quobyte-72265ef8-19b9-4749-a852-4056c7d3506f" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:27 devstack sudo[86830]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3 1G" returned: 0 in 0.664s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-72265ef8-19b9-4749-a852-4056c7d3506f" acquired by "delete_volume" :: waited 0.026s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:27 devstack sudo[86838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3
Apr 28 02:21:27 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:27 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa25715-8503-4de6-bec4-8e64ffea0f91]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-72265ef8-19b9-4749-a852-4056c7d3506f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:27 devstack sudo[86840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-72265ef8-19b9-4749-a852-4056c7d3506f
Apr 28 02:21:27 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:27 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3" returned: 0 in 0.482s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:27 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3 is being set with open permissions: ugo+rw
Apr 28 02:21:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:27 devstack sudo[86847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3
Apr 28 02:21:27 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:28 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-72265ef8-19b9-4749-a852-4056c7d3506f" returned: 0 in 0.549s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-72265ef8-19b9-4749-a852-4056c7d3506f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:28 devstack sudo[86850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-72265ef8-19b9-4749-a852-4056c7d3506f
Apr 28 02:21:28 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:28 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3" returned: 0 in 0.438s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.540s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] Creating offline snapshot d8463dd8-97d3-48e7-9571-2221fa9d55b1 of volume 5ecca10e-33f5-4fc7-afcc-63307d9c3d8f {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:21:28 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-92610541-c765-4569-94e5-5b2c8c4d6ce4 tempest-SnapshotsActionsTest-195656230 None] Create snapshot completed successfully
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3040436-0b2d-4644-9539-8143077cc6ad]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:28 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-72265ef8-19b9-4749-a852-4056c7d3506f" returned: 0 in 0.455s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-72265ef8-19b9-4749-a852-4056c7d3506f" released by "delete_volume" :: held 1.051s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:28 devstack sudo[86854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f
Apr 28 02:21:28 devstack sudo[86854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Created reservations ['f2dce770-6b32-4e86-b938-ba9567b638e8', '3c8cf866-1e49-49fd-af9f-4db746c7019c', '80531f95-65ae-4473-aca2-5f4455ab6107', '3d205a3e-caef-413f-8587-d7b6e5201872'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:28 devstack sudo[86856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:21:28 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Acquiring lock "cinder-a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Acquiring lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Acquiring lock "cinder-quobyte-a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Deleting offline snapshot a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3 of volume abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] snapshot_file for this snap is: volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[647e6edb-0e33-48d6-97a6-0782cbba4592]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:28 devstack sudo[86858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3
Apr 28 02:21:28 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:29 devstack sudo[86854]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f" returned: 0 in 0.541s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:29 devstack sudo[86863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1 1G
Apr 28 02:21:29 devstack sudo[86863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:29 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.495s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:21:29 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Deleted volume successfully.
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-47d09dbf-01c8-4d09-a952-429cf0e915de tempest-VolumesGetTest-1305963099 None] Lock "cinder-72265ef8-19b9-4749-a852-4056c7d3506f-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:29 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3" returned: 0 in 0.541s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd014e0-f94d-42d3-aa92-f7443ececebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0485383-5eba-4796-aa1c-718a9d820809]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:29 devstack sudo[86872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91
Apr 28 02:21:29 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:29 devstack sudo[86863]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1 1G" returned: 0 in 0.614s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:29 devstack sudo[86874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1
Apr 28 02:21:29 devstack sudo[86874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Lock "cinder-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-quobyte-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dd8193-54fd-4351-b931-ce6ccab2c8e3]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:29 devstack sudo[86876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4
Apr 28 02:21:29 devstack sudo[86876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:29 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91" returned: 0 in 0.578s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd014e0-f94d-42d3-aa92-f7443ececebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:30 devstack sudo[86881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3
Apr 28 02:21:30 devstack sudo[86881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:30 devstack sudo[86874]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1" returned: 0 in 0.554s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:30 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1 is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:30 devstack sudo[86886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1
Apr 28 02:21:30 devstack sudo[86886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:30 devstack sudo[86876]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4" returned: 0 in 0.567s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:30 devstack sudo[86891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4
Apr 28 02:21:30 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:30 devstack sudo[86881]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3" returned: 0 in 0.574s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:30 devstack sudo[86896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3
Apr 28 02:21:30 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:30 devstack sudo[86886]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1" returned: 0 in 0.509s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:30 devstack sudo[86900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.info
Apr 28 02:21:30 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:30 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4" returned: 0 in 0.472s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4" released by "delete_volume" :: held 1.090s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Created reservations ['0094ce5e-dae9-43c2-b3e5-0de1148be197', '03c4e978-059f-4cf4-b070-e749f9296ef3', '6c2dc08f-a71e-4883-8b58-3a634d59a129', '96bf6267-0906-444a-a6f5-72c00d681d9f'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:30 devstack sudo[86902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:21:30 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:31 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3" returned: 0 in 0.492s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3" released by "_delete_snapshot" :: held 2.278s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" released by "delete_snapshot" :: held 2.304s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Created reservations ['53a9b159-72d7-480a-91cd-fa71ffed2150', '6f1da04d-2fa0-4184-80a1-968bcdafde3c', '0b19d911-d300-469d-8517-239915bc5e94', '4369c1c9-2061-45b7-b532-b096400a437c'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:31 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.info" returned: 0 in 0.488s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:31 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:31 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Delete snapshot completed successfully.
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ae1b92e2-bcea-4dd7-87f2-d9970b3241ea tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-a2ea4f3a-e00b-44f2-8730-1da9fa8d76c3-delete_snapshot" released by "delete_snapshot" :: held 2.451s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:31 devstack sudo[86906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.info
Apr 28 02:21:31 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:31 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.452s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:21:31 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Deleted volume successfully.
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-12d14d14-224c-4e9f-81f2-921b607b5dfe tempest-VolumesGetTest-1305963099 None] Lock "cinder-e0fd026e-0227-4c49-8a0f-c04ddc2d7ec4-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:31 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.info" returned: 0 in 0.445s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.280s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:31 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6a47d0f9-b7dd-45d2-8555-04fb33f1c613 tempest-GroupSnapshotsTest-1032638190 None] group_snapshot cd00e76f-2032-4343-84a9-7609a93c69d8: created successfully
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-32573655-259c-46ff-a243-2624a5f8218e-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Lock "cinder-32573655-259c-46ff-a243-2624a5f8218e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-quobyte-32573655-259c-46ff-a243-2624a5f8218e" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-32573655-259c-46ff-a243-2624a5f8218e" acquired by "delete_volume" :: waited 0.024s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebda522-6640-4df9-9c03-be1ff597593b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:32 devstack sudo[86910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e
Apr 28 02:21:32 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:32 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] group_snapshot cd00e76f-2032-4343-84a9-7609a93c69d8: deleting
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] group_snapshot cd00e76f-2032-4343-84a9-7609a93c69d8: deleting {{(pid=81489) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] Creating offline snapshot d0a2cb91-065e-4b30-a5fa-4ffec00d32ea of volume abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[11783e69-f75e-48cb-846d-e7a1ca26d89d]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f" acquired by "delete_snapshot" :: waited 0.088s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-d8463dd8-97d3-48e7-9571-2221fa9d55b1" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-d8463dd8-97d3-48e7-9571-2221fa9d55b1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Deleting offline snapshot d8463dd8-97d3-48e7-9571-2221fa9d55b1 of volume 5ecca10e-33f5-4fc7-afcc-63307d9c3d8f {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] snapshot_file for this snap is: volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d509fa7-5e02-450d-9db6-dd762e682eaf]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:32 devstack sudo[86912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91
Apr 28 02:21:32 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:32 devstack sudo[86913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1
Apr 28 02:21:32 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:32 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e" returned: 0 in 0.607s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:32 devstack sudo[86919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e
Apr 28 02:21:32 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:32 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91" returned: 0 in 0.560s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd014e0-f94d-42d3-aa92-f7443ececebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:32 devstack sudo[86927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea 1G
Apr 28 02:21:32 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:32 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1" returned: 0 in 0.555s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29bdb3a-f9c5-425b-9d2c-73ab19195387]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:33 devstack sudo[86929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f
Apr 28 02:21:33 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:33 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-32573655-259c-46ff-a243-2624a5f8218e" returned: 0 in 0.480s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-32573655-259c-46ff-a243-2624a5f8218e" released by "delete_volume" :: held 1.155s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Created reservations ['f7c621e3-04c3-4941-84e0-6ef224280f96', '18ee5ae5-0878-4e67-80b8-26e1ee47df9f', 'b374438b-77c2-4386-aa26-1e598c873d9a', 'bc285b39-3259-44c7-b1f7-a57a27e79ca2'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:33 devstack sudo[86932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:21:33 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:33 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea 1G" returned: 0 in 0.633s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:33 devstack sudo[86940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea
Apr 28 02:21:33 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:33 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f" returned: 0 in 0.604s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:33 devstack sudo[86942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1
Apr 28 02:21:33 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:33 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.481s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:21:33 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Deleted volume successfully.
Apr 28 02:21:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0f16895-54ce-4ab9-8462-9ffad857f058 tempest-VolumesGetTest-1305963099 None] Lock "cinder-32573655-259c-46ff-a243-2624a5f8218e-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:34 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea" returned: 0 in 0.505s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:34 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea is being set with open permissions: ugo+rw
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:34 devstack sudo[86951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea
Apr 28 02:21:34 devstack sudo[86951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:34 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1" returned: 0 in 0.576s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:34 devstack sudo[86953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1
Apr 28 02:21:34 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:34 devstack sudo[86951]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea" returned: 0 in 0.526s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:34 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-5d12272a-6599-4cfd-86ca-e7814fd689a5 tempest-SnapshotsActionsTest-195656230 None] Create snapshot completed successfully
Apr 28 02:21:34 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f.d8463dd8-97d3-48e7-9571-2221fa9d55b1" returned: 0 in 0.518s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (976b9577-c217-4246-8ad7-99ff3ad3a9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6012bc68-4ebd-45fb-9080-01c06f434cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-d8463dd8-97d3-48e7-9571-2221fa9d55b1" released by "_delete_snapshot" :: held 2.369s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6012bc68-4ebd-45fb-9080-01c06f434cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1553074745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e11b315-68f7-4a2e-a81e-fe4281de94bf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89018e6ab95f4dc89ff92c9bd2f0eae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:35Z,use_quota=True,user_id='9f052c45255a4168bd86a2cb03ae96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3f7fde-edb3-46c8-b3cb-fa2176e74b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3f7fde-edb3-46c8-b3cb-fa2176e74b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8076869-f564-42a1-ae9f-f27807022b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG cinder.image.glance [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Creating Keystone auth plugin from conf {{(pid=81489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f" released by "delete_snapshot" :: held 2.420s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:34 devstack cinder-volume[81489]: WARNING cinder.quota [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1888852269 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1888852269, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:21:34 devstack cinder-volume[81489]: WARNING cinder.quota [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1888852269 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1888852269, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:21:34 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] Created reservations ['f2411d70-595e-4ef5-b992-929c4e1eaa0b', '79852f30-319a-4b37-9b26-cf4848554098', '8fc6135b-6344-41bd-b337-bfae3199dbfa', 'bbb06343-d1b0-4620-9b54-5fdb7e9b8855'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:34 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-53e734e0-ac19-452a-88e9-0787f85cdad7 tempest-GroupSnapshotsTest-1032638190 None] group_snapshot cd00e76f-2032-4343-84a9-7609a93c69d8: deleted successfully
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8076869-f564-42a1-ae9f-f27807022b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e11b315-68f7-4a2e-a81e-fe4281de94bf', 'volume_name': 'volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf', 'volume_size': 1, 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd359658886d548bfa4a779ff0e6805b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68696e90-4455-4dcc-8c91-372acb183045', 'created_at': datetime.datetime(2026, 4, 28, 0, 10, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 0, 10, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68696e90-4455-4dcc-8c91-372acb183045/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd3deba22f0>}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d41a6f4-98a0-4935-b7c3-ad47663b06fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d41a6f4-98a0-4935-b7c3-ad47663b06fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93bb3971-c638-4d08-9681-219cda2fe90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:35 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Volume 8e11b315-68f7-4a2e-a81e-fe4281de94bf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf', 'volume_size': 1, 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd359658886d548bfa4a779ff0e6805b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68696e90-4455-4dcc-8c91-372acb183045', 'created_at': datetime.datetime(2026, 4, 28, 0, 10, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 0, 10, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68696e90-4455-4dcc-8c91-372acb183045/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd3deba22f0>}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Trying to clone 8e11b315-68f7-4a2e-a81e-fe4281de94bf from image 68696e90-4455-4dcc-8c91-372acb183045 at location (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]). {{(pid=81489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81489) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 28 02:21:35 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Image download 20.69 MB at 20.69 MB/s
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[85829643-372e-4027-a0d3-c6c6e10c677e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Acquiring lock "cinder-d0a2cb91-065e-4b30-a5fa-4ffec00d32ea-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-d0a2cb91-065e-4b30-a5fa-4ffec00d32ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Acquiring lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Acquiring lock "cinder-quobyte-d0a2cb91-065e-4b30-a5fa-4ffec00d32ea" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-d0a2cb91-065e-4b30-a5fa-4ffec00d32ea" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Deleting offline snapshot d0a2cb91-065e-4b30-a5fa-4ffec00d32ea of volume abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] snapshot_file for this snap is: volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[627c4915-f652-4048-b502-f849fdcd97d8]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:35 devstack sudo[86959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD
Apr 28 02:21:35 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:35 devstack sudo[86960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea
Apr 28 02:21:35 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "cinder-quobyte-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7e3a6b-24e8-4ef8-a4a7-b84ffbfaa263]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:35 devstack sudo[86963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f
Apr 28 02:21:35 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:36 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD" returned: 0 in 0.551s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Temporary image 68696e90-4455-4dcc-8c91-372acb183045 is fetched for user 9f052c45255a4168bd86a2cb03ae96be. {{(pid=81489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4847ee2e-dab4-4250-a08f-2b9f3673eeb0]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:36 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea" returned: 0 in 0.568s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd014e0-f94d-42d3-aa92-f7443ececebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd38ce8-6e46-497d-81ce-b8bbc37c278c]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:36 devstack sudo[86971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD
Apr 28 02:21:36 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:36 devstack sudo[86972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91
Apr 28 02:21:36 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:36 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f" returned: 0 in 0.545s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:36 devstack sudo[86978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f
Apr 28 02:21:36 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:36 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD" returned: 0 in 0.567s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1553074745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e11b315-68f7-4a2e-a81e-fe4281de94bf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89018e6ab95f4dc89ff92c9bd2f0eae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:35Z,use_quota=True,user_id='9f052c45255a4168bd86a2cb03ae96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Creating volume 8e11b315-68f7-4a2e-a81e-fe4281de94bf {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:21:36 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:36 devstack sudo[86986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf 1073741824
Apr 28 02:21:36 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:36 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91" returned: 0 in 0.572s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd014e0-f94d-42d3-aa92-f7443ececebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:36 devstack sudo[86989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea
Apr 28 02:21:36 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:36 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f" returned: 0 in 0.476s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Lock "cinder-quobyte-5ecca10e-33f5-4fc7-afcc-63307d9c3d8f" released by "delete_volume" :: held 1.080s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Created reservations ['81dfe894-4d77-4579-a594-01b20211f3c1'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:36 devstack cinder-volume[81489]: WARNING cinder.quota [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1888852269 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1888852269, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:21:36 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Created reservations ['0ecb477d-69c8-4353-9201-498b342bd454', '38f24271-104b-4dfb-b054-bd2b195862c7', '17dbb86f-3c82-4641-b92c-b8bcb72f1e0c', '73ca5980-fe65-42f8-9351-cbd6a8bdf73e'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:37 devstack sudo[86994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:21:37 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:37 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf 1073741824" returned: 0 in 0.605s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:37 devstack sudo[87000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf
Apr 28 02:21:37 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:37 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea" returned: 0 in 0.660s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:37 devstack sudo[87002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea
Apr 28 02:21:37 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:37 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.490s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:21:37 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6211da0a-95f6-46fc-aec6-653360d615c7 tempest-GroupSnapshotsTest-1032638190 None] Delete group completed successfully.
Apr 28 02:21:37 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf" returned: 0 in 0.458s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG cinder.volume.volume_utils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Attempting download of 68696e90-4455-4dcc-8c91-372acb183045 ((None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}])) to volume 8e11b315-68f7-4a2e-a81e-fe4281de94bf. {{(pid=81489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 28 02:21:37 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.d0a2cb91-065e-4b30-a5fa-4ffec00d32ea" returned: 0 in 0.464s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-d0a2cb91-065e-4b30-a5fa-4ffec00d32ea" released by "_delete_snapshot" :: held 2.353s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" released by "delete_snapshot" :: held 2.374s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9852611c-94f9-4d4b-b60a-89f960de7465]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_aw6qbngo {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:38 devstack sudo[87007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_aw6qbngo
Apr 28 02:21:38 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:38 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Created reservations ['9cfd0e70-52de-4f25-9380-b2554b143a88', '41197d9c-c01b-4c73-9894-582429632095', '463d69d3-46a8-4bb9-a6cd-1187304da45b', 'e30edb96-3249-4bf0-aba1-12279797aac0'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:38 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Delete snapshot completed successfully.
Apr 28 02:21:38 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f7a392c4-402b-4ded-8d65-44c3d94edbad tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-d0a2cb91-065e-4b30-a5fa-4ffec00d32ea-delete_snapshot" released by "delete_snapshot" :: held 2.548s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:38 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_aw6qbngo" returned: 0 in 0.538s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_aw6qbngo {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:38 devstack sudo[87011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_aw6qbngo
Apr 28 02:21:38 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] Creating offline snapshot 4a31043d-ef6d-47d7-8963-217af00fef17 of volume abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:21:39 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_aw6qbngo" returned: 1 in 0.608s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045_aw6qbngo' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d05e9aa-58d6-48d1-9a22-1305ca7411c2]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0a2add-7bcd-4538-9457-aa8f11582809]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:39 devstack sudo[87016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD
Apr 28 02:21:39 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:39 devstack sudo[87017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91
Apr 28 02:21:39 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:39 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD" returned: 0 in 0.590s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] 68696e90-4455-4dcc-8c91-372acb183045 was qcow2, converting to raw {{(pid=81489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:39 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:39 devstack sudo[87027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf
Apr 28 02:21:39 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91" returned: 0 in 0.613s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd014e0-f94d-42d3-aa92-f7443ececebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:39 devstack sudo[87029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17 1G
Apr 28 02:21:39 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:40 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17 1G" returned: 0 in 0.821s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:40 devstack sudo[87041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17
Apr 28 02:21:40 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:41 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17" returned: 0 in 0.634s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:41 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17 is being set with open permissions: ugo+rw
Apr 28 02:21:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:41 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf" returned: 0 in 1.499s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:41 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_yfg_oxb9devstack@QuobyteHD, size 112.00 MB, duration 1.50 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:21:41 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Converted 112.00 MB image at 74.47 MB/s
Apr 28 02:21:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:41 devstack sudo[87046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17
Apr 28 02:21:41 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:41 devstack sudo[87047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf 1G
Apr 28 02:21:41 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:41 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17" returned: 0 in 0.456s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.638s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:41 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-18a064af-67e1-44e3-bb0e-978f792163a9 tempest-SnapshotsActionsTest-195656230 None] Create snapshot completed successfully
Apr 28 02:21:41 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf 1G" returned: 0 in 0.539s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:41 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1582ad4-83aa-461c-bc69-540740c8cef2]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:41 devstack sudo[87054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf
Apr 28 02:21:41 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Acquiring lock "cinder-4a31043d-ef6d-47d7-8963-217af00fef17-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-4a31043d-ef6d-47d7-8963-217af00fef17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Acquiring lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Acquiring lock "cinder-quobyte-4a31043d-ef6d-47d7-8963-217af00fef17" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-4a31043d-ef6d-47d7-8963-217af00fef17" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Deleting offline snapshot 4a31043d-ef6d-47d7-8963-217af00fef17 of volume abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] snapshot_file for this snap is: volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1cd651-3fee-4af0-b4f7-950f1a950c85]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:42 devstack sudo[87058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17
Apr 28 02:21:42 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:42 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf" returned: 0 in 0.653s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:42 devstack sudo[87060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf
Apr 28 02:21:42 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:42 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a6d78f89-fff5-4298-b46c-1ba251024d86 tempest-GroupSnapshotsV319Test-805873833 None] Group tempest-GroupSnapshotsV319Test-Group-603147246: creating
Apr 28 02:21:42 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a6d78f89-fff5-4298-b46c-1ba251024d86 tempest-GroupSnapshotsV319Test-805873833 None] Group tempest-GroupSnapshotsV319Test-Group-603147246: created successfully
Apr 28 02:21:42 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a6d78f89-fff5-4298-b46c-1ba251024d86 tempest-GroupSnapshotsV319Test-805873833 None] Create group completed successfully.
Apr 28 02:21:42 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17" returned: 0 in 0.581s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd014e0-f94d-42d3-aa92-f7443ececebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[99411fd4-c518-4979-997d-e30f7708d2ba]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:42 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf" returned: 1 in 0.553s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG cinder.volume.volume_utils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Downloaded image 68696e90-4455-4dcc-8c91-372acb183045 ((None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}])) to volume 8e11b315-68f7-4a2e-a81e-fe4281de94bf successfully. {{(pid=81489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 28 02:21:42 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Temporary image 68696e90-4455-4dcc-8c91-372acb183045 for user 9f052c45255a4168bd86a2cb03ae96be is deleted. {{(pid=81489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 28 02:21:43 devstack cinder-volume[81489]: DEBUG cinder.volume.volume_utils [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Marking volume 8e11b315-68f7-4a2e-a81e-fe4281de94bf as bootable. {{(pid=81489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 28 02:21:43 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Copying metadata from image 68696e90-4455-4dcc-8c91-372acb183045 to 8e11b315-68f7-4a2e-a81e-fe4281de94bf. {{(pid=81489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 28 02:21:43 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Creating volume glance metadata for volume 8e11b315-68f7-4a2e-a81e-fe4281de94bf backed by image 68696e90-4455-4dcc-8c91-372acb183045 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 28 02:21:43 devstack sudo[87068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91
Apr 28 02:21:43 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93bb3971-c638-4d08-9681-219cda2fe90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf', 'volume_size': 1, 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd359658886d548bfa4a779ff0e6805b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68696e90-4455-4dcc-8c91-372acb183045', 'created_at': datetime.datetime(2026, 4, 28, 0, 10, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 0, 10, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68696e90-4455-4dcc-8c91-372acb183045/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd3deba22f0>}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab5a020-16ae-4b57-a0b9-53d9b232fcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:43 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Volume volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf (8e11b315-68f7-4a2e-a81e-fe4281de94bf): created successfully
Apr 28 02:21:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab5a020-16ae-4b57-a0b9-53d9b232fcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (976b9577-c217-4246-8ad7-99ff3ad3a9a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:43 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a6f37f60-975c-475e-bce7-2b10a6c5ef6f tempest-VolumesGetTest-1305963099 None] Created volume successfully.
Apr 28 02:21:43 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91" returned: 0 in 0.534s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd014e0-f94d-42d3-aa92-f7443ececebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:43 devstack sudo[87073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17
Apr 28 02:21:43 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Flow 'volume_create_manager' (00f5fbe5-e143-4e13-aeff-59aa2d8162e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e941e4-c58b-4554-99d5-8387a8135342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19e941e4-c58b-4554-99d5-8387a8135342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2023637302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=59d7264c-f8bd-4020-a596-e3c74454cee3,host='devstack@QuobyteHD#QuobyteHD',id=34069641-3932-4e86-bed7-f69a61a38774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0320dce33545454b899051e1de8ba443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:44Z,use_quota=True,user_id='117b0d7f47864cdfaa7e989be5b74d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dc6b242-7332-4710-a5b7-f3a2469cddbb),volume_type_id=5dc6b242-7332-4710-a5b7-f3a2469cddbb)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:44 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c61af21-ab4a-47a3-aa41-980d62e1e71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c61af21-ab4a-47a3-aa41-980d62e1e71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19614f5-8460-44c9-96c2-327c53e35a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19614f5-8460-44c9-96c2-327c53e35a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34069641-3932-4e86-bed7-f69a61a38774', 'volume_name': 'volume-34069641-3932-4e86-bed7-f69a61a38774', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd78b173-2e61-4cd6-9cea-d2ea709c2e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd78b173-2e61-4cd6-9cea-d2ea709c2e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b461dd2-dffe-4253-ae10-6f2c7d18e961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:44 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Volume 34069641-3932-4e86-bed7-f69a61a38774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34069641-3932-4e86-bed7-f69a61a38774', 'volume_size': 1}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=59d7264c-f8bd-4020-a596-e3c74454cee3,created_at=2026-04-28T00:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2023637302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=59d7264c-f8bd-4020-a596-e3c74454cee3,host='devstack@QuobyteHD#QuobyteHD',id=34069641-3932-4e86-bed7-f69a61a38774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0320dce33545454b899051e1de8ba443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:44Z,use_quota=True,user_id='117b0d7f47864cdfaa7e989be5b74d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dc6b242-7332-4710-a5b7-f3a2469cddbb),volume_type_id=5dc6b242-7332-4710-a5b7-f3a2469cddbb)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Creating volume 34069641-3932-4e86-bed7-f69a61a38774 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:21:44 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17" returned: 0 in 0.705s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:44 devstack sudo[87078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774 1073741824
Apr 28 02:21:44 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:44 devstack sudo[87079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17
Apr 28 02:21:44 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:44 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4a31043d-ef6d-47d7-8963-217af00fef17" returned: 0 in 0.524s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-4a31043d-ef6d-47d7-8963-217af00fef17" released by "_delete_snapshot" :: held 2.447s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" released by "delete_snapshot" :: held 2.475s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Created reservations ['b46ed929-2c32-4741-8b42-33563d1afce1', '8ff61aec-4951-4304-9414-65a3baea3389', 'ad40b8c5-ba25-404f-b5d5-e946962262a4', '2c217778-0e38-44f1-b582-130fd6bcb009'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (32ffdebb-aec8-4071-b98b-4fb913aec343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf61fda-eade-42b6-b7ab-f010c1e87964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf61fda-eade-42b6-b7ab-f010c1e87964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1667831083',display_name='tempest-VolumesGetTest-Volume-751447444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2771af74-9d17-46ff-85d2-b3a016199339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89018e6ab95f4dc89ff92c9bd2f0eae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:45Z,use_quota=True,user_id='9f052c45255a4168bd86a2cb03ae96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:44 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193b981f-bd9f-4b32-b3d7-5dac296ec34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (193b981f-bd9f-4b32-b3d7-5dac296ec34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fb9309-8c92-497e-8d40-ff832112f4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fb9309-8c92-497e-8d40-ff832112f4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2771af74-9d17-46ff-85d2-b3a016199339', 'volume_name': 'volume-2771af74-9d17-46ff-85d2-b3a016199339', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab51c00-a4f8-467b-8738-35a5c7d3426b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab51c00-a4f8-467b-8738-35a5c7d3426b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fca022-a7f5-4ad2-9ee1-7fcec4d0faf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:44 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Volume 2771af74-9d17-46ff-85d2-b3a016199339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2771af74-9d17-46ff-85d2-b3a016199339', 'volume_size': 1}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774 1073741824" returned: 0 in 0.752s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:44 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Delete snapshot completed successfully.
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ee954b30-71d5-4d90-9733-19ad262438ea tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-4a31043d-ef6d-47d7-8963-217af00fef17-delete_snapshot" released by "delete_snapshot" :: held 2.724s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:45 devstack sudo[87086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774
Apr 28 02:21:45 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:45 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774" returned: 0 in 0.439s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.497s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1667831083',display_name='tempest-VolumesGetTest-Volume-751447444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2771af74-9d17-46ff-85d2-b3a016199339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89018e6ab95f4dc89ff92c9bd2f0eae4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:45Z,use_quota=True,user_id='9f052c45255a4168bd86a2cb03ae96be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Creating volume 2771af74-9d17-46ff-85d2-b3a016199339 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:21:45 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2771af74-9d17-46ff-85d2-b3a016199339 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b461dd2-dffe-4253-ae10-6f2c7d18e961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34069641-3932-4e86-bed7-f69a61a38774', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0630ab92-af50-437c-880c-2ad0331a31f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:45 devstack sudo[87089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2771af74-9d17-46ff-85d2-b3a016199339 1073741824
Apr 28 02:21:45 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:45 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Volume volume-34069641-3932-4e86-bed7-f69a61a38774 (34069641-3932-4e86-bed7-f69a61a38774): created successfully
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0630ab92-af50-437c-880c-2ad0331a31f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Flow 'volume_create_manager' (00f5fbe5-e143-4e13-aeff-59aa2d8162e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:45 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f7ceca13-371e-476a-91fb-6959d303e6be tempest-GroupSnapshotsV319Test-805873833 None] Created volume successfully.
Apr 28 02:21:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:46 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2771af74-9d17-46ff-85d2-b3a016199339 1073741824" returned: 0 in 0.629s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2771af74-9d17-46ff-85d2-b3a016199339 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:46 devstack sudo[87094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2771af74-9d17-46ff-85d2-b3a016199339
Apr 28 02:21:46 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:46 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] GroupSnapshot 3afe28e0-214a-40b5-ba9c-102c569631fb: creating.
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] Group snapshot 3afe28e0-214a-40b5-ba9c-102c569631fb: creating. {{(pid=81489) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:46 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2771af74-9d17-46ff-85d2-b3a016199339" returned: 0 in 0.473s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.853s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fca022-a7f5-4ad2-9ee1-7fcec4d0faf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2771af74-9d17-46ff-85d2-b3a016199339', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e5927a-a493-4178-a867-2eabd6d3aa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] Creating offline snapshot 6ca87977-3692-49b5-8993-e5602ba16f7e of volume abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:21:46 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Volume volume-2771af74-9d17-46ff-85d2-b3a016199339 (2771af74-9d17-46ff-85d2-b3a016199339): created successfully
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e5927a-a493-4178-a867-2eabd6d3aa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Flow 'volume_create_manager' (32ffdebb-aec8-4071-b98b-4fb913aec343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b10fdac-404c-47d0-a623-65d724215ae6]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:46 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d1de10f3-ccca-48bf-b4e2-b169d3bdd6a1 tempest-VolumesGetTest-1305963099 None] Created volume successfully.
Apr 28 02:21:46 devstack sudo[87131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91
Apr 28 02:21:46 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-2771af74-9d17-46ff-85d2-b3a016199339-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Lock "cinder-2771af74-9d17-46ff-85d2-b3a016199339-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-quobyte-2771af74-9d17-46ff-85d2-b3a016199339" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-2771af74-9d17-46ff-85d2-b3a016199339" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:47 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7cd7a7-f4b4-4ecd-8737-23c158fffa06]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2771af74-9d17-46ff-85d2-b3a016199339 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:47 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91" returned: 0 in 0.574s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:47 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd014e0-f94d-42d3-aa92-f7443ececebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:47 devstack sudo[87137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2771af74-9d17-46ff-85d2-b3a016199339
Apr 28 02:21:47 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:47 devstack sudo[87138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e 1G
Apr 28 02:21:47 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:47 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2771af74-9d17-46ff-85d2-b3a016199339" returned: 0 in 0.535s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2771af74-9d17-46ff-85d2-b3a016199339 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:47 devstack sudo[87147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2771af74-9d17-46ff-85d2-b3a016199339
Apr 28 02:21:47 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:47 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e 1G" returned: 0 in 0.646s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:47 devstack sudo[87149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e
Apr 28 02:21:47 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:48 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2771af74-9d17-46ff-85d2-b3a016199339" returned: 0 in 0.456s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-2771af74-9d17-46ff-85d2-b3a016199339" released by "delete_volume" :: held 1.039s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Created reservations ['d6536503-a1b9-4b32-a58c-3f3a8c3fb5a8', 'e38f1192-83ac-462d-8e23-2470fd2a0d24', '1c3693eb-b705-408d-912d-09436ee0ec5f', 'eb710bf3-96fa-4bad-a640-d27c8414b812'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:48 devstack sudo[87155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:21:48 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:48 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e" returned: 0 in 0.514s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:48 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e is being set with open permissions: ugo+rw
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:48 devstack sudo[87157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e
Apr 28 02:21:48 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:48 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.444s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:21:48 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Deleted volume successfully.
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8455f8ad-3002-4e94-b232-90af61d4751e tempest-VolumesGetTest-1305963099 None] Lock "cinder-2771af74-9d17-46ff-85d2-b3a016199339-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:48 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e" returned: 0 in 0.466s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.410s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] Creating offline snapshot 03ff5712-f536-43ab-b803-27765d649a06 of volume 34069641-3932-4e86-bed7-f69a61a38774 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:21:48 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d85ec46a-b185-4f1b-8ebe-2ff6f7370f73 tempest-SnapshotsActionsTest-195656230 None] Create snapshot completed successfully
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[378e5d43-41ec-45fb-862c-f8a2a1806d27]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:49 devstack sudo[87161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774
Apr 28 02:21:49 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-8e11b315-68f7-4a2e-a81e-fe4281de94bf-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Lock "cinder-8e11b315-68f7-4a2e-a81e-fe4281de94bf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:49 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=165,cinder:UPDATE=179,cinder:INSERT=57,cinder:DELETE=9 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:21:49 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:UPDATE=150,cinder:SELECT=152,cinder:INSERT=35,cinder:DELETE=12 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:21:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Acquiring lock "cinder-quobyte-8e11b315-68f7-4a2e-a81e-fe4281de94bf" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-8e11b315-68f7-4a2e-a81e-fe4281de94bf" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:49 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3642db5c-680f-4a41-ba83-a12945bee0cf]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:49 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774" returned: 0 in 0.575s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:49 devstack sudo[87167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06 1G
Apr 28 02:21:49 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:49 devstack sudo[87166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf
Apr 28 02:21:49 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Acquiring lock "cinder-6ca87977-3692-49b5-8993-e5602ba16f7e-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-6ca87977-3692-49b5-8993-e5602ba16f7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Acquiring lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Acquiring lock "cinder-quobyte-6ca87977-3692-49b5-8993-e5602ba16f7e" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-6ca87977-3692-49b5-8993-e5602ba16f7e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Deleting offline snapshot 6ca87977-3692-49b5-8993-e5602ba16f7e of volume abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] snapshot_file for this snap is: volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:21:50 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf" returned: 0 in 0.601s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[653a8350-3dcb-4363-9269-f65f509756a3]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:50 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06 1G" returned: 0 in 0.624s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34069641-3932-4e86-bed7-f69a61a38774 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:50 devstack sudo[87177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34069641-3932-4e86-bed7-f69a61a38774 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06
Apr 28 02:21:50 devstack sudo[87177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:50 devstack sudo[87175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf
Apr 28 02:21:50 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:50 devstack sudo[87176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e
Apr 28 02:21:50 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:50 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf" returned: 1 in 0.526s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:50 devstack sudo[87177]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34069641-3932-4e86-bed7-f69a61a38774 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06" returned: 0 in 0.501s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:50 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06 is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:50 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:50 devstack sudo[87190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf
Apr 28 02:21:50 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e" returned: 0 in 0.546s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd014e0-f94d-42d3-aa92-f7443ececebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:50 devstack sudo[87192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06
Apr 28 02:21:50 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7155652f-8065-4eaa-b73d-367c41a091ce]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:50 devstack sudo[87194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91
Apr 28 02:21:50 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:51 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8e11b315-68f7-4a2e-a81e-fe4281de94bf" returned: 0 in 0.434s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Lock "cinder-quobyte-8e11b315-68f7-4a2e-a81e-fe4281de94bf" released by "delete_volume" :: held 1.620s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:51 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06" returned: 0 in 0.443s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Created reservations ['58de42fe-5477-46dd-ae81-2755870c317a', '412670c7-e5ee-48bb-bf1a-8dcd76806c35', 'd0238cd8-42d2-4e16-8bb4-ffacac2d511f', '076a07c7-3bce-42e1-a7f0-10ef06c8fc88'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:51 devstack sudo[87200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.info
Apr 28 02:21:51 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:51 devstack sudo[87203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:21:51 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:51 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91" returned: 0 in 0.543s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd014e0-f94d-42d3-aa92-f7443ececebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:51 devstack sudo[87205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e
Apr 28 02:21:51 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:51 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.info" returned: 0 in 0.498s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:51 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:51 devstack sudo[87211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.info
Apr 28 02:21:51 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:51 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.494s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:21:51 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Deleted volume successfully.
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-40ad922e-bf20-410b-bdee-731f559083d0 tempest-VolumesGetTest-1305963099 None] Lock "cinder-8e11b315-68f7-4a2e-a81e-fe4281de94bf-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:51 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e" returned: 0 in 0.651s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:51 devstack sudo[87214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e
Apr 28 02:21:51 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:52 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.info" returned: 0 in 0.565s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.286s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:52 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-76e140a3-cb5a-4481-9f11-0a6ec4115ef6 tempest-GroupSnapshotsV319Test-805873833 None] group_snapshot 3afe28e0-214a-40b5-ba9c-102c569631fb: created successfully
Apr 28 02:21:52 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.6ca87977-3692-49b5-8993-e5602ba16f7e" returned: 0 in 0.506s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-6ca87977-3692-49b5-8993-e5602ba16f7e" released by "_delete_snapshot" :: held 2.348s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" released by "delete_snapshot" :: held 2.375s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Created reservations ['ce9e72ad-f84e-4e68-aa1f-7c6a28ba8048', '5954e224-3b5a-4048-b346-8608ca9b877d', 'e1750072-31ad-441b-a121-1a6ef8b02e8c', '574cdf87-c693-48f0-8ca4-561f4e978ff5'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:52 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Delete snapshot completed successfully.
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-dffa5a1b-90bc-4c9b-be16-1c833c45cee1 tempest-SnapshotsActionsTest-2126932526 None] Lock "cinder-6ca87977-3692-49b5-8993-e5602ba16f7e-delete_snapshot" released by "delete_snapshot" :: held 2.514s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:52 devstack sudo[87218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:21:52 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:53 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] group_snapshot 3afe28e0-214a-40b5-ba9c-102c569631fb: deleting
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] group_snapshot 3afe28e0-214a-40b5-ba9c-102c569631fb: deleting {{(pid=81489) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Acquiring lock "cinder-quobyte-34069641-3932-4e86-bed7-f69a61a38774" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:53 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.656s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Lock "cinder-quobyte-34069641-3932-4e86-bed7-f69a61a38774" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Acquiring lock "cinder-quobyte-03ff5712-f536-43ab-b803-27765d649a06" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Lock "cinder-quobyte-03ff5712-f536-43ab-b803-27765d649a06" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Deleting offline snapshot 03ff5712-f536-43ab-b803-27765d649a06 of volume 34069641-3932-4e86-bed7-f69a61a38774 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] snapshot_file for this snap is: volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3e7d2b-04ac-46bd-bfd0-0bb6c0f8d04e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:53 devstack sudo[87221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06
Apr 28 02:21:53 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Acquiring lock "cinder-4f5a89a8-a798-469b-acd5-36bfaf5afe91-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Lock "cinder-4f5a89a8-a798-469b-acd5-36bfaf5afe91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Acquiring lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Acquiring lock "cinder-quobyte-4f5a89a8-a798-469b-acd5-36bfaf5afe91" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Lock "cinder-quobyte-4f5a89a8-a798-469b-acd5-36bfaf5afe91" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Deleting offline snapshot 4f5a89a8-a798-469b-acd5-36bfaf5afe91 of volume abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] snapshot_file for this snap is: volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daba3ad-e298-4c33-87d8-5ed974213556]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:53 devstack sudo[87223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91
Apr 28 02:21:53 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:54 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06" returned: 0 in 0.662s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34069641-3932-4e86-bed7-f69a61a38774(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5eae29-88ea-45cd-9064-77c917baa1cc]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:54 devstack sudo[87228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774
Apr 28 02:21:54 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Flow 'volume_create_manager' (3cd14e1f-b1b7-4c06-9954-b37ede91c53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bc8330-79e3-44af-8efe-eb06ef7ed338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bc8330-79e3-44af-8efe-eb06ef7ed338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-524508081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b910d2fc-4dfe-4dbd-89ce-f51c093d2448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3de00749b248cc8fa6630c0db4f3c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:54Z,use_quota=True,user_id='c5f4f5d534f948b0a8f8cca81cb50d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c59b2fa-8fc6-412a-9775-787285334b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c59b2fa-8fc6-412a-9775-787285334b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559fd3ca-0772-42c9-9455-88ef0078a682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559fd3ca-0772-42c9-9455-88ef0078a682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b910d2fc-4dfe-4dbd-89ce-f51c093d2448', 'volume_name': 'volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7deacd-52b7-4206-b7c5-c18762f98025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7deacd-52b7-4206-b7c5-c18762f98025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c899767-c959-4067-b653-2661589aee70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:54 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Volume b910d2fc-4dfe-4dbd-89ce-f51c093d2448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448', 'volume_size': 1}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-524508081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b910d2fc-4dfe-4dbd-89ce-f51c093d2448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af3de00749b248cc8fa6630c0db4f3c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:21:54Z,use_quota=True,user_id='c5f4f5d534f948b0a8f8cca81cb50d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Creating volume b910d2fc-4dfe-4dbd-89ce-f51c093d2448 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:21:54 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:54 devstack sudo[87233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448 1073741824
Apr 28 02:21:54 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:54 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91" returned: 0 in 0.615s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd014e0-f94d-42d3-aa92-f7443ececebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddaa34b-17c1-4d66-ac71-237a55e65186]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:54 devstack sudo[87235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd
Apr 28 02:21:54 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:54 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774" returned: 0 in 0.565s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:54 devstack sudo[87240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06
Apr 28 02:21:54 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:54 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448 1073741824" returned: 0 in 0.639s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:55 devstack sudo[87251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448
Apr 28 02:21:55 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:55 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd" returned: 0 in 0.611s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:55 devstack sudo[87253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91
Apr 28 02:21:55 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:55 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06" returned: 0 in 0.555s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:55 devstack sudo[87255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06
Apr 28 02:21:55 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:55 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448" returned: 0 in 0.508s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c899767-c959-4067-b653-2661589aee70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78186c28-08f6-4b9a-b1c0-3dabb7fbdc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:21:55 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Volume volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448 (b910d2fc-4dfe-4dbd-89ce-f51c093d2448): created successfully
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78186c28-08f6-4b9a-b1c0-3dabb7fbdc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Flow 'volume_create_manager' (3cd14e1f-b1b7-4c06-9954-b37ede91c53e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:21:55 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-fe7bb217-9bf3-46b5-8526-9ec8b1d7abd4 tempest-VolumesNegativeTest-267428325 None] Created volume successfully.
Apr 28 02:21:55 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91" returned: 0 in 0.576s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:55 devstack sudo[87262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91
Apr 28 02:21:55 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:55 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774.03ff5712-f536-43ab-b803-27765d649a06" returned: 0 in 0.488s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Lock "cinder-quobyte-03ff5712-f536-43ab-b803-27765d649a06" released by "_delete_snapshot" :: held 2.383s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Lock "cinder-quobyte-34069641-3932-4e86-bed7-f69a61a38774" released by "delete_snapshot" :: held 2.413s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:55 devstack cinder-volume[81489]: WARNING cinder.quota [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-884656090 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-884656090, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:21:55 devstack cinder-volume[81489]: WARNING cinder.quota [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-884656090 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-884656090, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:21:55 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] Created reservations ['0571d74b-7536-4291-8471-926d75ebbf24', '66e7d7f5-cc03-47b4-bc83-7b574b0045fe', 'a12a20b6-268a-489b-a67a-882e98d3daaa', 'cb9ac1e6-c657-4111-bd69-79d691d294de'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:55 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-14ac18d1-5431-4011-8b0e-ac116d673f84 tempest-GroupSnapshotsV319Test-805873833 None] group_snapshot 3afe28e0-214a-40b5-ba9c-102c569631fb: deleted successfully
Apr 28 02:21:56 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd.4f5a89a8-a798-469b-acd5-36bfaf5afe91" returned: 0 in 0.448s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Lock "cinder-quobyte-4f5a89a8-a798-469b-acd5-36bfaf5afe91" released by "_delete_snapshot" :: held 2.344s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" released by "delete_snapshot" :: held 2.367s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:56 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Created reservations ['7b09cc9e-6b50-46aa-ad70-92aca8279009', '1b12ba2e-c2c0-491f-948b-2938aecc1081', 'e35c41bf-a3f3-4184-8951-384f00fa83fa', 'defeeb42-ec01-47f2-936d-cf2c7ffd5ade'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:56 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Delete snapshot completed successfully.
Apr 28 02:21:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b6f19898-074f-4f00-ae30-2313778c6afd tempest-SnapshotsActionsTest-195656230 None] Lock "cinder-4f5a89a8-a798-469b-acd5-36bfaf5afe91-delete_snapshot" released by "delete_snapshot" :: held 2.480s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Acquiring lock "cinder-quobyte-34069641-3932-4e86-bed7-f69a61a38774" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Lock "cinder-quobyte-34069641-3932-4e86-bed7-f69a61a38774" acquired by "delete_volume" :: waited 0.025s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:56 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3021f7-d932-41a4-855e-e6b56885c0ee]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:56 devstack sudo[87265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774
Apr 28 02:21:56 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Acquiring lock "cinder-abd014e0-f94d-42d3-aa92-f7443ececebd-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Lock "cinder-abd014e0-f94d-42d3-aa92-f7443ececebd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Acquiring lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:21:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:21:57 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f207e29c-f0fb-47e4-832b-a73ad0eb8176]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:21:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:57 devstack sudo[87271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd
Apr 28 02:21:57 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:57 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774" returned: 0 in 0.631s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:57 devstack sudo[87276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774
Apr 28 02:21:57 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:57 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd" returned: 0 in 0.551s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:57 devstack sudo[87281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd
Apr 28 02:21:57 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:57 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-34069641-3932-4e86-bed7-f69a61a38774" returned: 0 in 0.492s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Lock "cinder-quobyte-34069641-3932-4e86-bed7-f69a61a38774" released by "delete_volume" :: held 1.197s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:57 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Created reservations ['69391a40-df84-4d37-ba11-24af21a33a16'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:58 devstack cinder-volume[81489]: WARNING cinder.quota [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-884656090 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-884656090, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Created reservations ['37c1468c-d094-4b56-885b-633f0cd5ffe2', 'c4b97849-2131-482a-a040-7a0c6e50e759', '419fc992-e1cb-40f8-8fe4-7da13910d2c8', '8ded0646-f9b7-4ec0-b182-3b6477ef949e'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:58 devstack sudo[87286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:21:58 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:58 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abd014e0-f94d-42d3-aa92-f7443ececebd" returned: 0 in 0.576s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Lock "cinder-quobyte-abd014e0-f94d-42d3-aa92-f7443ececebd" released by "delete_volume" :: held 1.184s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Created reservations ['884e7aa9-698c-4e58-ac9a-efdcd99982df', '9ba63ac8-cf47-44d6-8966-a234bfac2cef', '2d505be2-d234-43f8-8d02-4f5a948aaf35', 'dee71538-8ecd-4cb2-924f-84ed3708c5a6'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:21:58 devstack sudo[87288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:21:58 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:21:58 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.440s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:21:58 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-089b90c2-abca-43c9-b5d8-a7c03459f79c tempest-GroupSnapshotsV319Test-805873833 None] Delete group completed successfully.
Apr 28 02:21:58 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.456s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:21:58 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Deleted volume successfully.
Apr 28 02:21:58 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b4d6fa3f-0a07-47ef-a5c3-b601fe780db7 tempest-SnapshotsActionsTest-195656230 None] Lock "cinder-abd014e0-f94d-42d3-aa92-f7443ececebd-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:08 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=47,cinder:UPDATE=45,cinder:DELETE=2,cinder:INSERT=17 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:22:08 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=36,cinder:UPDATE=52,cinder:INSERT=10,cinder:DELETE=1 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Flow 'volume_create_manager' (c9be4288-39dc-4bd9-a8af-cf5844ad9748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3859a703-0151-4978-9c6d-c6bcd15d56d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3859a703-0151-4978-9c6d-c6bcd15d56d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-705000643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a9deaa-6b2f-4b57-81e0-ad0565c1047f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5f89648e94426a7f1417b47534577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:12Z,use_quota=True,user_id='24195c4a51f14eee8ffab8db4d1b4901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c2bafd-1327-43bf-b3d8-41b58216720e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c2bafd-1327-43bf-b3d8-41b58216720e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c948c62e-74f9-42ef-b44d-90e6415477fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c948c62e-74f9-42ef-b44d-90e6415477fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a9deaa-6b2f-4b57-81e0-ad0565c1047f', 'volume_name': 'volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f65198-a403-4b68-b0f2-91db475fcb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f65198-a403-4b68-b0f2-91db475fcb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024b7fe2-5132-4571-afc9-9a04141e4267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:11 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Volume d6a9deaa-6b2f-4b57-81e0-ad0565c1047f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f', 'volume_size': 1}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-705000643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a9deaa-6b2f-4b57-81e0-ad0565c1047f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5f89648e94426a7f1417b47534577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:12Z,use_quota=True,user_id='24195c4a51f14eee8ffab8db4d1b4901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Creating volume d6a9deaa-6b2f-4b57-81e0-ad0565c1047f {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:22:11 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:22:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:11 devstack sudo[87356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f 1073741824
Apr 28 02:22:11 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:12 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f 1073741824" returned: 0 in 0.740s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:12 devstack sudo[87363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f
Apr 28 02:22:12 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:13 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f" returned: 0 in 0.585s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:22:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024b7fe2-5132-4571-afc9-9a04141e4267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2c1106-5fbd-40e1-bce7-210eb7a71415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:13 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Volume volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f (d6a9deaa-6b2f-4b57-81e0-ad0565c1047f): created successfully
Apr 28 02:22:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2c1106-5fbd-40e1-bce7-210eb7a71415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Flow 'volume_create_manager' (c9be4288-39dc-4bd9-a8af-cf5844ad9748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:13 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-5f7803a4-4ffc-4296-b718-06d9a73f5f9e tempest-VolumeQuotasAdminTestJSON-2121778313 None] Created volume successfully.
Apr 28 02:22:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Acquiring lock "cinder-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "cinder-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Acquiring lock "cinder-quobyte-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "cinder-quobyte-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:14 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d985ad-dd74-46b8-882f-0a2137621a41]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:22:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:14 devstack sudo[87366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f
Apr 28 02:22:14 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:14 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f" returned: 0 in 0.756s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:14 devstack sudo[87372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f
Apr 28 02:22:14 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:15 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f" returned: 0 in 0.600s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "cinder-quobyte-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f" released by "delete_volume" :: held 1.426s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:15 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Created reservations ['e955df2f-fe87-4317-bfb9-07db957dffcc', '6a887e47-0e0c-4a4e-9608-732ac0c6c2d5', 'e3d6e4b6-ae69-416f-93b6-1eed536ae693', '80b4bf4a-bf16-4298-8ade-67a768b64bc8'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:22:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:15 devstack sudo[87375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:22:15 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:16 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.547s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:22:16 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Deleted volume successfully.
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3083addf-4092-439e-af7c-5411460d6945 tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "cinder-d6a9deaa-6b2f-4b57-81e0-ad0565c1047f-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Flow 'volume_create_manager' (4416b7aa-5ccd-4c07-ad25-9be3699a7c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1279ec9-8116-41bd-86fb-22f4895a6868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1279ec9-8116-41bd-86fb-22f4895a6868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1194081347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3944c2f-f116-4c22-95c8-5e527422ab61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5f89648e94426a7f1417b47534577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:17Z,use_quota=True,user_id='24195c4a51f14eee8ffab8db4d1b4901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87d00bc-6507-4176-80dc-45c7fc37a420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87d00bc-6507-4176-80dc-45c7fc37a420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f42607c-7024-4aaa-8c29-54b07eac350b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f42607c-7024-4aaa-8c29-54b07eac350b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3944c2f-f116-4c22-95c8-5e527422ab61', 'volume_name': 'volume-a3944c2f-f116-4c22-95c8-5e527422ab61', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73003f7e-58ab-4487-99fc-4b7a737e88a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73003f7e-58ab-4487-99fc-4b7a737e88a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13ed113-6a0b-4b4e-8c0d-320ed0a967fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:16 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Volume a3944c2f-f116-4c22-95c8-5e527422ab61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3944c2f-f116-4c22-95c8-5e527422ab61', 'volume_size': 1}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1194081347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3944c2f-f116-4c22-95c8-5e527422ab61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33f5f89648e94426a7f1417b47534577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:17Z,use_quota=True,user_id='24195c4a51f14eee8ffab8db4d1b4901',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Creating volume a3944c2f-f116-4c22-95c8-5e527422ab61 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:22:16 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:22:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a3944c2f-f116-4c22-95c8-5e527422ab61 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:16 devstack sudo[87408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a3944c2f-f116-4c22-95c8-5e527422ab61 1073741824
Apr 28 02:22:16 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:17 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a3944c2f-f116-4c22-95c8-5e527422ab61 1073741824" returned: 0 in 0.694s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a3944c2f-f116-4c22-95c8-5e527422ab61 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:17 devstack sudo[87415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a3944c2f-f116-4c22-95c8-5e527422ab61
Apr 28 02:22:17 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:18 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a3944c2f-f116-4c22-95c8-5e527422ab61" returned: 0 in 0.566s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:22:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13ed113-6a0b-4b4e-8c0d-320ed0a967fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3944c2f-f116-4c22-95c8-5e527422ab61', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42083154-908e-4696-96f3-056bc188ec8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:18 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Volume volume-a3944c2f-f116-4c22-95c8-5e527422ab61 (a3944c2f-f116-4c22-95c8-5e527422ab61): created successfully
Apr 28 02:22:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42083154-908e-4696-96f3-056bc188ec8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Flow 'volume_create_manager' (4416b7aa-5ccd-4c07-ad25-9be3699a7c68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:18 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-1919362f-d318-407d-b985-c509b6010faf tempest-VolumeQuotasAdminTestJSON-2121778313 None] Created volume successfully.
Apr 28 02:22:19 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a9edf713-f58a-4fd8-907d-5e5231ee4a79 tempest-VolumeQuotasAdminTestJSON-298762422 None] Transfer volume completed successfully.
Apr 28 02:22:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Acquiring lock "cinder-a3944c2f-f116-4c22-95c8-5e527422ab61-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Lock "cinder-a3944c2f-f116-4c22-95c8-5e527422ab61-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Acquiring lock "cinder-quobyte-a3944c2f-f116-4c22-95c8-5e527422ab61" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Lock "cinder-quobyte-a3944c2f-f116-4c22-95c8-5e527422ab61" acquired by "delete_volume" :: waited 0.048s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:20 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[410f65b1-462a-4efd-b016-66d1f3b90869]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:22:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a3944c2f-f116-4c22-95c8-5e527422ab61 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:21 devstack sudo[87420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a3944c2f-f116-4c22-95c8-5e527422ab61
Apr 28 02:22:21 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:21 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a3944c2f-f116-4c22-95c8-5e527422ab61" returned: 0 in 0.563s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a3944c2f-f116-4c22-95c8-5e527422ab61 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:21 devstack sudo[87432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a3944c2f-f116-4c22-95c8-5e527422ab61
Apr 28 02:22:21 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:21 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a3944c2f-f116-4c22-95c8-5e527422ab61" returned: 0 in 0.475s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:21 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Lock "cinder-quobyte-a3944c2f-f116-4c22-95c8-5e527422ab61" released by "delete_volume" :: held 1.096s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:22 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Created reservations ['50ce8c8d-b915-4a68-b742-ae7f699f626f', '4388ba49-af44-4a49-b437-1db9a2312409', 'a82a23c4-ab84-4b67-9691-e32d3bee935f', 'e3c9f943-5673-4d36-92e0-320cbd5e746d'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:22:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:22 devstack sudo[87435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:22:22 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:22 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.520s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:22 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:22:22 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Deleted volume successfully.
Apr 28 02:22:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9b7fef9e-56ee-4c0d-ab17-0d18dc2ebb3e tempest-VolumeQuotasAdminTestJSON-373010667 None] Lock "cinder-a3944c2f-f116-4c22-95c8-5e527422ab61-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Acquiring lock "cinder-b910d2fc-4dfe-4dbd-89ce-f51c093d2448-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Lock "cinder-b910d2fc-4dfe-4dbd-89ce-f51c093d2448-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Acquiring lock "cinder-quobyte-b910d2fc-4dfe-4dbd-89ce-f51c093d2448" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Lock "cinder-quobyte-b910d2fc-4dfe-4dbd-89ce-f51c093d2448" acquired by "delete_volume" :: waited 0.028s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:29 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ab8a49-abc1-4a41-bf77-7aa0800ebcd9]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:22:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:30 devstack sudo[87443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448
Apr 28 02:22:30 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:30 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448" returned: 0 in 0.681s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:30 devstack sudo[87448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448
Apr 28 02:22:30 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:31 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b910d2fc-4dfe-4dbd-89ce-f51c093d2448" returned: 0 in 0.634s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Lock "cinder-quobyte-b910d2fc-4dfe-4dbd-89ce-f51c093d2448" released by "delete_volume" :: held 1.368s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:31 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Created reservations ['f0588f63-7401-4f22-b994-de24fa9c7c6d', '856441bd-6aa9-4829-9a22-22a173177b66', 'a53f8843-479a-4642-830a-900540e5874a', '508a2300-95dd-4526-94b5-9191ffea587c'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:22:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:31 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:31 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:31 devstack sudo[87451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:22:31 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:32 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.577s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:32 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:22:32 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Deleted volume successfully.
Apr 28 02:22:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3c846a55-f264-4ce0-97de-ba35f4981c66 tempest-VolumesNegativeTest-267428325 None] Lock "cinder-b910d2fc-4dfe-4dbd-89ce-f51c093d2448-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Flow 'volume_create_manager' (c94f1545-d842-411c-8b6c-0f888453c0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e84a13b-2ca4-46f2-8f3f-c95f4576dd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e84a13b-2ca4-46f2-8f3f-c95f4576dd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-488888276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e5cd6c-0670-4fb4-8b89-9afd09734f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f1926f4774cd2a10994e7047c455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:35Z,use_quota=True,user_id='055753a8a2a34ebfb7e56a03d6c7aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268cfeab-1eb2-4ffb-a1de-928eda3d899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268cfeab-1eb2-4ffb-a1de-928eda3d899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1663917e-3d30-4263-bcb6-85baf518b980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1663917e-3d30-4263-bcb6-85baf518b980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e5cd6c-0670-4fb4-8b89-9afd09734f89', 'volume_name': 'volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cba1958-b2fe-4423-9012-efd423b38ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cba1958-b2fe-4423-9012-efd423b38ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed808364-ea7e-463c-a4d4-6b2d69fb2d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:35 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Volume a0e5cd6c-0670-4fb4-8b89-9afd09734f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89', 'volume_size': 1}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-488888276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e5cd6c-0670-4fb4-8b89-9afd09734f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f1926f4774cd2a10994e7047c455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:35Z,use_quota=True,user_id='055753a8a2a34ebfb7e56a03d6c7aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Creating volume a0e5cd6c-0670-4fb4-8b89-9afd09734f89 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:22:35 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:35 devstack sudo[87455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89 1073741824
Apr 28 02:22:35 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Flow 'volume_create_manager' (d91594f1-7a0b-45c4-96b6-c944f03c8606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe790d22-b5e6-4aa5-a832-913c14167375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe790d22-b5e6-4aa5-a832-913c14167375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-607919326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d409dff5-f2dd-42ac-a234-92730a3f0405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f1926f4774cd2a10994e7047c455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:36Z,use_quota=True,user_id='055753a8a2a34ebfb7e56a03d6c7aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b6a78f-5800-44f4-acb4-b1ad5cbd5853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b6a78f-5800-44f4-acb4-b1ad5cbd5853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f7f592-b5ee-484d-bc17-e7bb7ecf8c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f7f592-b5ee-484d-bc17-e7bb7ecf8c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd409dff5-f2dd-42ac-a234-92730a3f0405', 'volume_name': 'volume-d409dff5-f2dd-42ac-a234-92730a3f0405', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e04230d-4a8a-4f9e-8d0a-98a65a8bc428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e04230d-4a8a-4f9e-8d0a-98a65a8bc428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc02137-d551-4b0e-ad9b-f4125713e3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:35 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Volume d409dff5-f2dd-42ac-a234-92730a3f0405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d409dff5-f2dd-42ac-a234-92730a3f0405', 'volume_size': 1}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Flow 'volume_create_manager' (fa2fa168-8d44-4bc5-a95a-20d70530e752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfae142d-94d8-4b76-af64-5fe35e24b261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfae142d-94d8-4b76-af64-5fe35e24b261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1280512344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82aa9a8d-48b7-407d-8ad6-9841009a5d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50740376e5e546f08ee74b656f19902e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:36Z,use_quota=True,user_id='0bab3601dc76493d8fc29d0f843e5053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a8d2a6-56a3-435e-8c87-50ef2f064b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a8d2a6-56a3-435e-8c87-50ef2f064b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819250d5-0c8e-4d1d-8dd9-ea96322548d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819250d5-0c8e-4d1d-8dd9-ea96322548d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82aa9a8d-48b7-407d-8ad6-9841009a5d30', 'volume_name': 'volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffa7189-eebe-48a9-a28c-969433da380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffa7189-eebe-48a9-a28c-969433da380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2e15e8-cb88-45c3-85b7-22189c94fc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Volume 82aa9a8d-48b7-407d-8ad6-9841009a5d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30', 'volume_size': 1}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Flow 'volume_create_manager' (bc5d183c-5ce9-435f-8a2b-a5a82e07f89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6298b0d5-0cca-40b4-9bf9-fb4d76a29ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6298b0d5-0cca-40b4-9bf9-fb4d76a29ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1695234715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e747d720-7849-4070-a958-f50e68f6cbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f1926f4774cd2a10994e7047c455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:36Z,use_quota=True,user_id='055753a8a2a34ebfb7e56a03d6c7aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc35a29b-3194-4dd1-9bea-b5aa7d3db686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc35a29b-3194-4dd1-9bea-b5aa7d3db686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34cfd4f1-4f59-430c-a91b-ce49c2a3b120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34cfd4f1-4f59-430c-a91b-ce49c2a3b120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e747d720-7849-4070-a958-f50e68f6cbda', 'volume_name': 'volume-e747d720-7849-4070-a958-f50e68f6cbda', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec759d9-f268-4559-883c-c0f7d2bf68c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec759d9-f268-4559-883c-c0f7d2bf68c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296fa22c-c561-4714-8641-6ba99a9c95ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Volume e747d720-7849-4070-a958-f50e68f6cbda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e747d720-7849-4070-a958-f50e68f6cbda', 'volume_size': 1}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Flow 'volume_create_manager' (05f68bdc-543a-413a-901b-9998253d95e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14710a0a-5d57-4a6d-b06f-e2116c4a1cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14710a0a-5d57-4a6d-b06f-e2116c4a1cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-679588760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aedaf3-b64c-4da4-8768-01e74fb32636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f1926f4774cd2a10994e7047c455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:36Z,use_quota=True,user_id='055753a8a2a34ebfb7e56a03d6c7aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9f5e38-6ef0-4fea-a006-7008d188b053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9f5e38-6ef0-4fea-a006-7008d188b053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe48c35-e348-4735-92a7-5551a21b8981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe48c35-e348-4735-92a7-5551a21b8981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91aedaf3-b64c-4da4-8768-01e74fb32636', 'volume_name': 'volume-91aedaf3-b64c-4da4-8768-01e74fb32636', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63d92ee-89bb-4fe9-a308-c87e6a7130ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63d92ee-89bb-4fe9-a308-c87e6a7130ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af14286-a3ab-4d5a-958f-ffacab508308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Volume 91aedaf3-b64c-4da4-8768-01e74fb32636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91aedaf3-b64c-4da4-8768-01e74fb32636', 'volume_size': 1}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:36 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89 1073741824" returned: 0 in 1.019s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:36 devstack sudo[87460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89
Apr 28 02:22:36 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Flow 'volume_create_manager' (692e252d-0b3f-429c-889d-9f7a217c07f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdbd597-c28f-4105-8602-4ccceb3c0f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fdbd597-c28f-4105-8602-4ccceb3c0f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-144201360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1c804d-a518-4270-9e28-8dd114f5274c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f1926f4774cd2a10994e7047c455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:36Z,use_quota=True,user_id='055753a8a2a34ebfb7e56a03d6c7aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f234138f-3637-4deb-8ba2-645318e7a82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f234138f-3637-4deb-8ba2-645318e7a82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4390ab-6309-4ede-9f51-dacc8fd5dfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f4390ab-6309-4ede-9f51-dacc8fd5dfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd1c804d-a518-4270-9e28-8dd114f5274c', 'volume_name': 'volume-cd1c804d-a518-4270-9e28-8dd114f5274c', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cec0e8e-fba4-453a-b476-6544a1a3a382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cec0e8e-fba4-453a-b476-6544a1a3a382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e830b8-8d09-4f26-9434-8fc1304b19fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:36 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Volume cd1c804d-a518-4270-9e28-8dd114f5274c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd1c804d-a518-4270-9e28-8dd114f5274c', 'volume_size': 1}
Apr 28 02:22:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:37 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89" returned: 0 in 0.529s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.158s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-607919326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d409dff5-f2dd-42ac-a234-92730a3f0405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f1926f4774cd2a10994e7047c455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:36Z,use_quota=True,user_id='055753a8a2a34ebfb7e56a03d6c7aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Creating volume d409dff5-f2dd-42ac-a234-92730a3f0405 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:22:37 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d409dff5-f2dd-42ac-a234-92730a3f0405 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:37 devstack sudo[87464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d409dff5-f2dd-42ac-a234-92730a3f0405 1073741824
Apr 28 02:22:37 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed808364-ea7e-463c-a4d4-6b2d69fb2d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b9e993-a364-4549-9f01-0d5ccea03828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:37 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Volume volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89 (a0e5cd6c-0670-4fb4-8b89-9afd09734f89): created successfully
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b9e993-a364-4549-9f01-0d5ccea03828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Flow 'volume_create_manager' (c94f1545-d842-411c-8b6c-0f888453c0ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:37 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-9eb5d73a-f49b-4c11-b4dc-740c466cdada tempest-CreateVolumesFromImageTest-1012776070 None] Created volume successfully.
Apr 28 02:22:37 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d409dff5-f2dd-42ac-a234-92730a3f0405 1073741824" returned: 0 in 0.727s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d409dff5-f2dd-42ac-a234-92730a3f0405 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:37 devstack sudo[87469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d409dff5-f2dd-42ac-a234-92730a3f0405
Apr 28 02:22:37 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:38 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d409dff5-f2dd-42ac-a234-92730a3f0405" returned: 0 in 0.459s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.235s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1280512344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82aa9a8d-48b7-407d-8ad6-9841009a5d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50740376e5e546f08ee74b656f19902e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:36Z,use_quota=True,user_id='0bab3601dc76493d8fc29d0f843e5053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Creating volume 82aa9a8d-48b7-407d-8ad6-9841009a5d30 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:22:38 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc02137-d551-4b0e-ad9b-f4125713e3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d409dff5-f2dd-42ac-a234-92730a3f0405', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:38 devstack sudo[87472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30 1073741824
Apr 28 02:22:38 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b71a5a-1584-4a4a-bb79-587a0e4f829d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:38 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Volume volume-d409dff5-f2dd-42ac-a234-92730a3f0405 (d409dff5-f2dd-42ac-a234-92730a3f0405): created successfully
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05b71a5a-1584-4a4a-bb79-587a0e4f829d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Flow 'volume_create_manager' (d91594f1-7a0b-45c4-96b6-c944f03c8606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:38 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6efa557a-6f52-42b3-a38b-e27378cf974d tempest-CreateVolumesFromImageTest-1012776070 None] Created volume successfully.
Apr 28 02:22:38 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30 1073741824" returned: 0 in 0.678s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:39 devstack sudo[87477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30
Apr 28 02:22:39 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:39 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30" returned: 0 in 0.484s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.320s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1695234715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e747d720-7849-4070-a958-f50e68f6cbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f1926f4774cd2a10994e7047c455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:36Z,use_quota=True,user_id='055753a8a2a34ebfb7e56a03d6c7aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Creating volume e747d720-7849-4070-a958-f50e68f6cbda {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:22:39 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e747d720-7849-4070-a958-f50e68f6cbda 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2e15e8-cb88-45c3-85b7-22189c94fc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9a3a47-2fe1-4139-9af9-aca4c514113f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:39 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Volume volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30 (82aa9a8d-48b7-407d-8ad6-9841009a5d30): created successfully
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9a3a47-2fe1-4139-9af9-aca4c514113f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:39 devstack sudo[87480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e747d720-7849-4070-a958-f50e68f6cbda 1073741824
Apr 28 02:22:39 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:39 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Flow 'volume_create_manager' (fa2fa168-8d44-4bc5-a95a-20d70530e752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:39 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a4fa478b-4bab-4d16-a5ea-acda6666e6b9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Created volume successfully.
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:40 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e747d720-7849-4070-a958-f50e68f6cbda 1073741824" returned: 0 in 0.903s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e747d720-7849-4070-a958-f50e68f6cbda {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:40 devstack sudo[87485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e747d720-7849-4070-a958-f50e68f6cbda
Apr 28 02:22:40 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:40 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e747d720-7849-4070-a958-f50e68f6cbda" returned: 0 in 0.504s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.642s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-679588760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aedaf3-b64c-4da4-8768-01e74fb32636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f1926f4774cd2a10994e7047c455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:36Z,use_quota=True,user_id='055753a8a2a34ebfb7e56a03d6c7aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Creating volume 91aedaf3-b64c-4da4-8768-01e74fb32636 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:22:40 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91aedaf3-b64c-4da4-8768-01e74fb32636 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296fa22c-c561-4714-8641-6ba99a9c95ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e747d720-7849-4070-a958-f50e68f6cbda', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764dfd22-468d-4239-9b9d-2570257ed979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:40 devstack sudo[87488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91aedaf3-b64c-4da4-8768-01e74fb32636 1073741824
Apr 28 02:22:40 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:40 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Volume volume-e747d720-7849-4070-a958-f50e68f6cbda (e747d720-7849-4070-a958-f50e68f6cbda): created successfully
Apr 28 02:22:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764dfd22-468d-4239-9b9d-2570257ed979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Flow 'volume_create_manager' (bc5d183c-5ce9-435f-8a2b-a5a82e07f89f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:41 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-1312b50b-bfe1-4788-85df-f61977f31d91 tempest-CreateVolumesFromImageTest-1012776070 None] Created volume successfully.
Apr 28 02:22:41 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91aedaf3-b64c-4da4-8768-01e74fb32636 1073741824" returned: 0 in 0.712s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91aedaf3-b64c-4da4-8768-01e74fb32636 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:41 devstack sudo[87494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91aedaf3-b64c-4da4-8768-01e74fb32636
Apr 28 02:22:41 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:42 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91aedaf3-b64c-4da4-8768-01e74fb32636" returned: 0 in 0.484s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.562s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-144201360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1c804d-a518-4270-9e28-8dd114f5274c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f1926f4774cd2a10994e7047c455b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:36Z,use_quota=True,user_id='055753a8a2a34ebfb7e56a03d6c7aab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Creating volume cd1c804d-a518-4270-9e28-8dd114f5274c {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:22:42 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cd1c804d-a518-4270-9e28-8dd114f5274c 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af14286-a3ab-4d5a-958f-ffacab508308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91aedaf3-b64c-4da4-8768-01e74fb32636', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be5debc-1386-4c9b-9984-174d72bb7a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:42 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cd1c804d-a518-4270-9e28-8dd114f5274c 1073741824
Apr 28 02:22:42 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:42 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Volume volume-91aedaf3-b64c-4da4-8768-01e74fb32636 (91aedaf3-b64c-4da4-8768-01e74fb32636): created successfully
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be5debc-1386-4c9b-9984-174d72bb7a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Flow 'volume_create_manager' (05f68bdc-543a-413a-901b-9998253d95e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:42 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-9356d9e6-a83a-4916-a773-4e2955f41fef tempest-CreateVolumesFromImageTest-1012776070 None] Created volume successfully.
Apr 28 02:22:42 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cd1c804d-a518-4270-9e28-8dd114f5274c 1073741824" returned: 0 in 0.678s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cd1c804d-a518-4270-9e28-8dd114f5274c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:42 devstack sudo[87502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cd1c804d-a518-4270-9e28-8dd114f5274c
Apr 28 02:22:42 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:43 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cd1c804d-a518-4270-9e28-8dd114f5274c" returned: 0 in 0.463s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:22:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.273s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e830b8-8d09-4f26-9434-8fc1304b19fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1c804d-a518-4270-9e28-8dd114f5274c', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a57346-210e-4dbc-a946-1fe9feec6aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Creating offline snapshot 4c724d1d-1263-4503-b51f-bef1bd995095 of volume 82aa9a8d-48b7-407d-8ad6-9841009a5d30 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:22:43 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Volume volume-cd1c804d-a518-4270-9e28-8dd114f5274c (cd1c804d-a518-4270-9e28-8dd114f5274c): created successfully
Apr 28 02:22:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a57346-210e-4dbc-a946-1fe9feec6aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:43 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Flow 'volume_create_manager' (692e252d-0b3f-429c-889d-9f7a217c07f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:43 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f36321-1f1a-410d-b170-17a400dd0dc1]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:22:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:43 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-7c380ab3-400b-496c-be18-61f546a86fbf tempest-CreateVolumesFromImageTest-1012776070 None] Created volume successfully.
Apr 28 02:22:43 devstack sudo[87505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30
Apr 28 02:22:43 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:44 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30" returned: 0 in 0.573s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:44 devstack sudo[87510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095 1G
Apr 28 02:22:44 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "cinder-cd1c804d-a518-4270-9e28-8dd114f5274c-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-cd1c804d-a518-4270-9e28-8dd114f5274c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "cinder-quobyte-cd1c804d-a518-4270-9e28-8dd114f5274c" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-quobyte-cd1c804d-a518-4270-9e28-8dd114f5274c" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:44 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7bee45-b9fe-444c-a643-47e7056858f7]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:22:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cd1c804d-a518-4270-9e28-8dd114f5274c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:44 devstack sudo[87512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cd1c804d-a518-4270-9e28-8dd114f5274c
Apr 28 02:22:44 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:44 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095 1G" returned: 0 in 0.874s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:44 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095
Apr 28 02:22:44 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:45 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cd1c804d-a518-4270-9e28-8dd114f5274c" returned: 0 in 0.694s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cd1c804d-a518-4270-9e28-8dd114f5274c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:45 devstack sudo[87522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cd1c804d-a518-4270-9e28-8dd114f5274c
Apr 28 02:22:45 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:45 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095" returned: 0 in 0.589s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:45 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095 is being set with open permissions: ugo+rw
Apr 28 02:22:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:45 devstack sudo[87527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095
Apr 28 02:22:45 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:45 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cd1c804d-a518-4270-9e28-8dd114f5274c" returned: 0 in 0.533s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-quobyte-cd1c804d-a518-4270-9e28-8dd114f5274c" released by "delete_volume" :: held 1.279s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:45 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Created reservations ['91f2f0d2-17eb-43c6-9451-c3152e24be2f', 'b33a1ae2-e0fb-4bf2-98aa-148dab8f15f1', 'e877a456-951e-4216-9f65-4fb76d013b7e', '7ec918a4-5141-4170-8bdc-487ffc4e401c'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:22:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:45 devstack sudo[87530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:22:45 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:46 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095" returned: 0 in 0.565s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:46 devstack sudo[87536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.info
Apr 28 02:22:46 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:46 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.515s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:46 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:22:46 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Deleted volume successfully.
Apr 28 02:22:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-e3a5afdc-79b3-4532-ab4b-3b877bbca188 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-cd1c804d-a518-4270-9e28-8dd114f5274c-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "cinder-91aedaf3-b64c-4da4-8768-01e74fb32636-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-91aedaf3-b64c-4da4-8768-01e74fb32636-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:46 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.info" returned: 0 in 0.595s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:46 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.info is being set with open permissions: ugo+rw
Apr 28 02:22:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:46 devstack sudo[87552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.info
Apr 28 02:22:46 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "cinder-quobyte-91aedaf3-b64c-4da4-8768-01e74fb32636" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-quobyte-91aedaf3-b64c-4da4-8768-01e74fb32636" acquired by "delete_volume" :: waited 0.026s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:46 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0e2fe7-0d9a-4efa-b939-43d588463f51]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:22:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91aedaf3-b64c-4da4-8768-01e74fb32636 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:46 devstack sudo[87575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91aedaf3-b64c-4da4-8768-01e74fb32636
Apr 28 02:22:46 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:47 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.info" returned: 0 in 0.521s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.832s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:47 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-0adfe5b0-e6b7-4f7f-bbb8-6e0e167a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Create snapshot completed successfully
Apr 28 02:22:47 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91aedaf3-b64c-4da4-8768-01e74fb32636" returned: 0 in 0.577s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91aedaf3-b64c-4da4-8768-01e74fb32636 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:47 devstack sudo[87584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91aedaf3-b64c-4da4-8768-01e74fb32636
Apr 28 02:22:47 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Acquiring lock "cinder-4c724d1d-1263-4503-b51f-bef1bd995095-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "cinder-4c724d1d-1263-4503-b51f-bef1bd995095-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Acquiring lock "cinder-quobyte-82aa9a8d-48b7-407d-8ad6-9841009a5d30" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "cinder-quobyte-82aa9a8d-48b7-407d-8ad6-9841009a5d30" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Acquiring lock "cinder-quobyte-4c724d1d-1263-4503-b51f-bef1bd995095" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "cinder-quobyte-4c724d1d-1263-4503-b51f-bef1bd995095" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Deleting offline snapshot 4c724d1d-1263-4503-b51f-bef1bd995095 of volume 82aa9a8d-48b7-407d-8ad6-9841009a5d30 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] snapshot_file for this snap is: volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecce2952-acdb-4b13-9506-36d91fcec8fa]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:47 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91aedaf3-b64c-4da4-8768-01e74fb32636" returned: 0 in 0.544s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-quobyte-91aedaf3-b64c-4da4-8768-01e74fb32636" released by "delete_volume" :: held 1.177s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:47 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Created reservations ['40482009-34c0-4153-883e-bdcfbdef9978', 'd298e94e-57ad-4efb-a9b8-4fa08dfa57cc', 'bc41b0e8-6bff-4266-a218-6f51ef85baf4', 'e5762455-b089-41ed-bcee-ef73f772a581'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:22:47 devstack sudo[87587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095
Apr 28 02:22:47 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:48 devstack sudo[87589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:22:48 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:48 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095" returned: 0 in 0.554s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fc7148-b82f-4e54-b611-924546b6c9a8]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:48 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.468s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:22:48 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Deleted volume successfully.
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b20f78f6-9053-4cb6-935a-3850e32d4d49 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-91aedaf3-b64c-4da4-8768-01e74fb32636-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:48 devstack sudo[87595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30
Apr 28 02:22:48 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "cinder-e747d720-7849-4070-a958-f50e68f6cbda-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-e747d720-7849-4070-a958-f50e68f6cbda-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "cinder-quobyte-e747d720-7849-4070-a958-f50e68f6cbda" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-quobyte-e747d720-7849-4070-a958-f50e68f6cbda" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:49 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[daef1dd0-fdd4-46a0-ab58-6839004f5b49]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:22:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e747d720-7849-4070-a958-f50e68f6cbda {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:49 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30" returned: 0 in 0.573s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:49 devstack sudo[87600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e747d720-7849-4070-a958-f50e68f6cbda
Apr 28 02:22:49 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:49 devstack sudo[87601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095
Apr 28 02:22:49 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:49 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e747d720-7849-4070-a958-f50e68f6cbda" returned: 0 in 0.547s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e747d720-7849-4070-a958-f50e68f6cbda {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:49 devstack sudo[87610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e747d720-7849-4070-a958-f50e68f6cbda
Apr 28 02:22:49 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:49 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095" returned: 0 in 0.589s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:49 devstack sudo[87612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095
Apr 28 02:22:49 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:50 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e747d720-7849-4070-a958-f50e68f6cbda" returned: 0 in 0.494s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-quobyte-e747d720-7849-4070-a958-f50e68f6cbda" released by "delete_volume" :: held 1.084s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Created reservations ['4f6bfb46-d772-4289-a284-2bd02449d90b', '92779246-4828-438e-91c8-2332d60baa5b', '8fe6309a-b314-4bae-9046-2f47b50f6150', '5c84e8c0-30ef-4d36-ba9b-3603647795fd'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:22:50 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30.4c724d1d-1263-4503-b51f-bef1bd995095" returned: 0 in 0.490s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "cinder-quobyte-4c724d1d-1263-4503-b51f-bef1bd995095" released by "_delete_snapshot" :: held 2.339s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "cinder-quobyte-82aa9a8d-48b7-407d-8ad6-9841009a5d30" released by "delete_snapshot" :: held 2.368s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:50 devstack sudo[87616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:22:50 devstack sudo[87616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Created reservations ['1e35bda8-25c5-47ce-a82b-c9aa11a3cbc9', '02a6dcaa-5109-48cd-b9b1-23532b93189d', 'ba60292a-2f37-46b9-99c9-8ada8a7c5399', 'c95c139b-d2d2-4421-845e-12720725e2f6'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:22:50 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Delete snapshot completed successfully.
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2dbc37a6-ecab-4ad9-804d-4cfbc8e1925b tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "cinder-4c724d1d-1263-4503-b51f-bef1bd995095-delete_snapshot" released by "delete_snapshot" :: held 2.617s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:50 devstack sudo[87616]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.522s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:22:50 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Deleted volume successfully.
Apr 28 02:22:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b1f88088-bcb2-495f-85a5-6406c28dca93 tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-e747d720-7849-4070-a958-f50e68f6cbda-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Acquiring lock "cinder-82aa9a8d-48b7-407d-8ad6-9841009a5d30-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "cinder-82aa9a8d-48b7-407d-8ad6-9841009a5d30-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "cinder-d409dff5-f2dd-42ac-a234-92730a3f0405-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-d409dff5-f2dd-42ac-a234-92730a3f0405-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Acquiring lock "cinder-quobyte-82aa9a8d-48b7-407d-8ad6-9841009a5d30" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "cinder-quobyte-82aa9a8d-48b7-407d-8ad6-9841009a5d30" acquired by "delete_volume" :: waited 0.032s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[febe7515-24b2-4171-9662-667442a3a415]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "cinder-quobyte-d409dff5-f2dd-42ac-a234-92730a3f0405" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-quobyte-d409dff5-f2dd-42ac-a234-92730a3f0405" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf315f9-df70-4cd6-8049-d11e79400956]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d409dff5-f2dd-42ac-a234-92730a3f0405 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:51 devstack sudo[87621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30
Apr 28 02:22:51 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:51 devstack sudo[87622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d409dff5-f2dd-42ac-a234-92730a3f0405
Apr 28 02:22:51 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:51 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30" returned: 0 in 0.610s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:51 devstack sudo[87631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30
Apr 28 02:22:51 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:52 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d409dff5-f2dd-42ac-a234-92730a3f0405" returned: 0 in 0.683s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d409dff5-f2dd-42ac-a234-92730a3f0405 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:52 devstack sudo[87633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d409dff5-f2dd-42ac-a234-92730a3f0405
Apr 28 02:22:52 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:52 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-82aa9a8d-48b7-407d-8ad6-9841009a5d30" returned: 0 in 0.562s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "cinder-quobyte-82aa9a8d-48b7-407d-8ad6-9841009a5d30" released by "delete_volume" :: held 1.242s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Created reservations ['cbb13af9-ce52-4447-aa7d-9e4c524b444d', '1a3628bf-0aa8-4371-a54e-a8c9be6ce781', '9915b78a-3f21-4bf3-816c-4dcbeda63116', '91389f38-6b73-4129-adf7-ed575b5f75d2'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:22:52 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d409dff5-f2dd-42ac-a234-92730a3f0405" returned: 0 in 0.540s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-quobyte-d409dff5-f2dd-42ac-a234-92730a3f0405" released by "delete_volume" :: held 1.290s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:52 devstack sudo[87642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:22:52 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Created reservations ['2d769641-d540-4e05-95cb-8533b2668494', '1b0602f0-1072-4dc8-8302-7d7a2e52cd1d', '0be13db3-574d-431f-a05e-e6849346074f', 'f50d82a7-74e0-4b0d-9f4a-39adbafb5fda'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:22:52 devstack sudo[87646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:22:52 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:52 devstack sudo[87652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:22:52 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:53 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.629s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:22:53 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.489s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:22:53 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Deleted volume successfully.
Apr 28 02:22:53 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.612s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:22:53 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Deleted volume successfully.
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-e690268c-4374-442e-8625-a4f3a243760b tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-d409dff5-f2dd-42ac-a234-92730a3f0405-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3a53a15b-426d-4e85-a465-896ee83a398f tempest-VolumeSnapshotQuotasNegativeTestJSON-1569435722 None] Lock "cinder-82aa9a8d-48b7-407d-8ad6-9841009a5d30-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "cinder-a0e5cd6c-0670-4fb4-8b89-9afd09734f89-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-a0e5cd6c-0670-4fb4-8b89-9afd09734f89-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "cinder-quobyte-a0e5cd6c-0670-4fb4-8b89-9afd09734f89" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-quobyte-a0e5cd6c-0670-4fb4-8b89-9afd09734f89" acquired by "delete_volume" :: waited 0.032s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da4049b-17de-4221-9bda-904bac5e302b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:22:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:53 devstack sudo[87662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89
Apr 28 02:22:53 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:54 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89" returned: 0 in 0.588s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:54 devstack sudo[87667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89
Apr 28 02:22:54 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:54 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a0e5cd6c-0670-4fb4-8b89-9afd09734f89" returned: 0 in 0.565s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-quobyte-a0e5cd6c-0670-4fb4-8b89-9afd09734f89" released by "delete_volume" :: held 1.214s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:54 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Created reservations ['4d434268-fe57-47f4-a456-6d91f6bb8ea7', '2395611d-8176-436f-b81e-7c61095e0af4', '388bfd14-b852-439f-80ed-4ef793987955', '815c7a66-4de8-45b2-8348-780d35cf80ae'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:22:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:54 devstack sudo[87670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:22:54 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:22:55 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root
Apr 28 02:22:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.601s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:22:55 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:22:55 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Deleted volume successfully.
Apr 28 02:22:55 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-115644f6-8dde-410b-8063-3d874cd425cf tempest-CreateVolumesFromImageTest-1012776070 None] Lock "cinder-a0e5cd6c-0670-4fb4-8b89-9afd09734f89-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Flow 'volume_create_manager' (b56c0a74-8730-40a2-b548-0993f3496128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a20e0dd-a2ca-49ac-99f5-a34f7650b4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a20e0dd-a2ca-49ac-99f5-a34f7650b4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-159935095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada842ef-d3f9-4422-af88-7f6498fa6b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e5d067762f4db6b388244fce5e5321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:59Z,use_quota=True,user_id='d666b116c39f4cecb52717f6750a36f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab9f29d-d448-4aed-8f58-691e5f1d84b4),volume_type_id=8ab9f29d-d448-4aed-8f58-691e5f1d84b4)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5316c84-3338-4c86-bd72-1c3ba2481296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5316c84-3338-4c86-bd72-1c3ba2481296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c332cb7-9cf8-4f20-af83-b01be6e1b98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c332cb7-9cf8-4f20-af83-b01be6e1b98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada842ef-d3f9-4422-af88-7f6498fa6b4f', 'volume_name': 'volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6720391b-5450-47bb-8efd-0409361bb03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6720391b-5450-47bb-8efd-0409361bb03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deaf4b6f-06b7-4fbf-8d2b-8d16df99b77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:22:59 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Volume ada842ef-d3f9-4422-af88-7f6498fa6b4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f', 'volume_size': 1}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-159935095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada842ef-d3f9-4422-af88-7f6498fa6b4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e5d067762f4db6b388244fce5e5321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:22:59Z,use_quota=True,user_id='d666b116c39f4cecb52717f6750a36f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ab9f29d-d448-4aed-8f58-691e5f1d84b4),volume_type_id=8ab9f29d-d448-4aed-8f58-691e5f1d84b4)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Creating volume ada842ef-d3f9-4422-af88-7f6498fa6b4f {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:22:59 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:22:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:22:59 devstack sudo[87721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f 1073741824
Apr 28 02:22:59 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:00 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f 1073741824" returned: 0 in 1.089s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:00 devstack sudo[87728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f
Apr 28 02:23:00 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:01 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f" returned: 0 in 0.673s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deaf4b6f-06b7-4fbf-8d2b-8d16df99b77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecd8822-777f-47c4-bf33-6d5279781544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:01 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Volume volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f (ada842ef-d3f9-4422-af88-7f6498fa6b4f): created successfully
Apr 28 02:23:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecd8822-777f-47c4-bf33-6d5279781544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Flow 'volume_create_manager' (b56c0a74-8730-40a2-b548-0993f3496128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:01 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-67b89d42-8ca7-4a4d-be82-c910c4c59140 tempest-VolumeTypesAccessTest-1389751709 None] Created volume successfully.
Apr 28 02:23:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Acquiring lock "cinder-ada842ef-d3f9-4422-af88-7f6498fa6b4f-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Lock "cinder-ada842ef-d3f9-4422-af88-7f6498fa6b4f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Acquiring lock "cinder-quobyte-ada842ef-d3f9-4422-af88-7f6498fa6b4f" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Lock "cinder-quobyte-ada842ef-d3f9-4422-af88-7f6498fa6b4f" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:01 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdc207d-7267-43f0-b438-c81219fb9141]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:01 devstack sudo[87731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f
Apr 28 02:23:01 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:02 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f" returned: 0 in 0.711s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:02 devstack sudo[87736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f
Apr 28 02:23:02 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Flow 'volume_create_manager' (60f992b3-e9b9-4ba9-81fb-2dbaf5e094e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658cf0f5-ccc0-4401-b37e-893e522d8d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658cf0f5-ccc0-4401-b37e-893e522d8d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1407560738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174329d4-ad99-41fe-9dd1-806e6b2dd0cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1abaaaf09a354c789a385557aa382fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:03Z,use_quota=True,user_id='d4b72139124c4844a85e6708eed4611f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfd8386-ad6d-4892-b960-d4c391e4a080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfd8386-ad6d-4892-b960-d4c391e4a080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44527c8a-22b1-472f-96b4-6e2d1bee59d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44527c8a-22b1-472f-96b4-6e2d1bee59d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '174329d4-ad99-41fe-9dd1-806e6b2dd0cc', 'volume_name': 'volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256fea51-8caf-481b-aa18-9e700f2e5d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256fea51-8caf-481b-aa18-9e700f2e5d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670829ed-de9b-407a-be11-b3cff887ce91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:02 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Volume 174329d4-ad99-41fe-9dd1-806e6b2dd0cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc', 'volume_size': 1}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1407560738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174329d4-ad99-41fe-9dd1-806e6b2dd0cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1abaaaf09a354c789a385557aa382fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:03Z,use_quota=True,user_id='d4b72139124c4844a85e6708eed4611f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Creating volume 174329d4-ad99-41fe-9dd1-806e6b2dd0cc {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:02 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:02 devstack sudo[87739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc 1073741824
Apr 28 02:23:02 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:02 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ada842ef-d3f9-4422-af88-7f6498fa6b4f" returned: 0 in 0.760s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Lock "cinder-quobyte-ada842ef-d3f9-4422-af88-7f6498fa6b4f" released by "delete_volume" :: held 1.550s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:02 devstack cinder-volume[81489]: WARNING cinder.quota [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1593524388 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1593524388, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:23:02 devstack cinder-volume[81489]: WARNING cinder.quota [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1593524388 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1593524388, it is now deprecated. Please use the default quota class for default quota.
Apr 28 02:23:03 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Created reservations ['abb1eeab-0d3f-47ac-9916-6b7552b106a3', 'ccf015dd-271a-40dc-8dd4-42ea004ff4d3', '41c25576-7a7d-46de-8877-02618f25a058', '262c476b-e912-4b7a-9e4d-e997fb43468a'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:03 devstack sudo[87741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:03 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:03 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc 1073741824" returned: 0 in 0.842s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:03 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.739s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:03 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:03 devstack sudo[87747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc
Apr 28 02:23:03 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:03 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Deleted volume successfully.
Apr 28 02:23:03 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-713b260a-fd81-4e11-a6cd-88fc1fac9ec9 tempest-VolumeTypesAccessTest-1389751709 None] Lock "cinder-ada842ef-d3f9-4422-af88-7f6498fa6b4f-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:04 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc" returned: 0 in 0.823s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670829ed-de9b-407a-be11-b3cff887ce91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c68e984-2111-43ec-9a0f-15f5cd91ed32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:04 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Volume volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc (174329d4-ad99-41fe-9dd1-806e6b2dd0cc): created successfully
Apr 28 02:23:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c68e984-2111-43ec-9a0f-15f5cd91ed32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Flow 'volume_create_manager' (60f992b3-e9b9-4ba9-81fb-2dbaf5e094e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:04 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a526a285-2811-4ee6-b341-7ec6edc9c457 tempest-VolumesActionsTest-222740078 None] Created volume successfully.
Apr 28 02:23:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1cbc3279-e2f6-4e18-91ff-3d21b0e52154 tempest-VolumesActionsTest-222740078 None] Acquiring lock "cinder-174329d4-ad99-41fe-9dd1-806e6b2dd0cc" by "attach_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1cbc3279-e2f6-4e18-91ff-3d21b0e52154 tempest-VolumesActionsTest-222740078 None] Lock "cinder-174329d4-ad99-41fe-9dd1-806e6b2dd0cc" acquired by "attach_volume" :: waited 0.027s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:05 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-1cbc3279-e2f6-4e18-91ff-3d21b0e52154 tempest-VolumesActionsTest-222740078 None] Attaching volume 174329d4-ad99-41fe-9dd1-806e6b2dd0cc to instance 02a4d5d5-b3c2-4c22-9fcc-fcf587563dd2 at mountpoint /dev/vdb on host None.
Apr 28 02:23:05 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-1cbc3279-e2f6-4e18-91ff-3d21b0e52154 tempest-VolumesActionsTest-222740078 None] Attach volume completed successfully.
Apr 28 02:23:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1cbc3279-e2f6-4e18-91ff-3d21b0e52154 tempest-VolumesActionsTest-222740078 None] Lock "cinder-174329d4-ad99-41fe-9dd1-806e6b2dd0cc" released by "attach_volume" :: held 0.113s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:06 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d0e1bcac-904f-4981-af5b-2fedcf0d3134 tempest-VolumesActionsTest-55382510 None] Terminate volume connection completed successfully.
Apr 28 02:23:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0e1bcac-904f-4981-af5b-2fedcf0d3134 tempest-VolumesActionsTest-55382510 None] Acquiring lock "cinder-174329d4-ad99-41fe-9dd1-806e6b2dd0cc-detach_volume" by "detach_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0e1bcac-904f-4981-af5b-2fedcf0d3134 tempest-VolumesActionsTest-55382510 None] Lock "cinder-174329d4-ad99-41fe-9dd1-806e6b2dd0cc-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:07 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d0e1bcac-904f-4981-af5b-2fedcf0d3134 tempest-VolumesActionsTest-55382510 None] Detaching volume 174329d4-ad99-41fe-9dd1-806e6b2dd0cc from instance 02a4d5d5-b3c2-4c22-9fcc-fcf587563dd2.
Apr 28 02:23:07 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d0e1bcac-904f-4981-af5b-2fedcf0d3134 tempest-VolumesActionsTest-55382510 None] Detach volume completed successfully.
Apr 28 02:23:07 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0e1bcac-904f-4981-af5b-2fedcf0d3134 tempest-VolumesActionsTest-55382510 None] Lock "cinder-174329d4-ad99-41fe-9dd1-806e6b2dd0cc-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:07 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-773e5a79-3e23-4613-bfda-54bd2747ec28 tempest-VolumesActionsTest-222740078 None] Acquiring lock "cinder-174329d4-ad99-41fe-9dd1-806e6b2dd0cc-detach_volume" by "detach_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:07 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-773e5a79-3e23-4613-bfda-54bd2747ec28 tempest-VolumesActionsTest-222740078 None] Lock "cinder-174329d4-ad99-41fe-9dd1-806e6b2dd0cc-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:07 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-773e5a79-3e23-4613-bfda-54bd2747ec28 tempest-VolumesActionsTest-222740078 None] Volume detach called, but volume not attached.
Apr 28 02:23:07 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-773e5a79-3e23-4613-bfda-54bd2747ec28 tempest-VolumesActionsTest-222740078 None] Lock "cinder-174329d4-ad99-41fe-9dd1-806e6b2dd0cc-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:08 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Acquiring lock "cinder-174329d4-ad99-41fe-9dd1-806e6b2dd0cc-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:08 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Lock "cinder-174329d4-ad99-41fe-9dd1-806e6b2dd0cc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:08 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Acquiring lock "cinder-quobyte-174329d4-ad99-41fe-9dd1-806e6b2dd0cc" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:08 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Lock "cinder-quobyte-174329d4-ad99-41fe-9dd1-806e6b2dd0cc" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:08 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabcd559-edfd-425d-b65d-17f031851af7]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:08 devstack sudo[87753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc
Apr 28 02:23:08 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:09 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc" returned: 0 in 0.763s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:09 devstack sudo[87758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc
Apr 28 02:23:09 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:10 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-174329d4-ad99-41fe-9dd1-806e6b2dd0cc" returned: 0 in 0.598s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:10 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Lock "cinder-quobyte-174329d4-ad99-41fe-9dd1-806e6b2dd0cc" released by "delete_volume" :: held 1.434s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:10 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=87,cinder:UPDATE=116,cinder:INSERT=30,cinder:DELETE=9 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:23:10 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:UPDATE=127,cinder:SELECT=92,cinder:INSERT=27,cinder:DELETE=12 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:23:10 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Created reservations ['4d23885a-50f7-47b0-96b7-43632277a8fa', '8348d4ea-64ae-48c0-97d6-a629b34cd1fd', '3815cf72-a204-4a36-b221-5efcf4ee03d3', '4957e5b6-58a7-4a94-bece-1ed2c018960c'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:10 devstack sudo[87761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:10 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:11 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.674s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:11 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:11 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Deleted volume successfully.
Apr 28 02:23:11 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-813b2a6f-926e-45d7-b545-9b84cd33ce67 tempest-VolumesActionsTest-222740078 None] Lock "cinder-174329d4-ad99-41fe-9dd1-806e6b2dd0cc-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Flow 'volume_create_manager' (248ddfc3-ad36-45d6-9b00-39d5af4a84c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0dff9af-51d8-4e3e-8133-e61c9cf9540c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0dff9af-51d8-4e3e-8133-e61c9cf9540c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-825508173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ad2800-782c-4639-8676-3e44f6c575e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e1afb30dc04ea89d831a48984b7364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:13Z,use_quota=True,user_id='7ae2774088804ea68f214b4b01b0d8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5ade30-4da4-4f2a-8b05-6bf78a737dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5ade30-4da4-4f2a-8b05-6bf78a737dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b840b782-db01-4ee5-94ce-54314ad19350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b840b782-db01-4ee5-94ce-54314ad19350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10ad2800-782c-4639-8676-3e44f6c575e5', 'volume_name': 'volume-10ad2800-782c-4639-8676-3e44f6c575e5', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24ecefb-8691-47b4-bf34-0cf961827dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e24ecefb-8691-47b4-bf34-0cf961827dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4431c93-275b-44d2-85ba-4aa6b1928a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:12 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Volume 10ad2800-782c-4639-8676-3e44f6c575e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10ad2800-782c-4639-8676-3e44f6c575e5', 'volume_size': 1}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-825508173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10ad2800-782c-4639-8676-3e44f6c575e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e1afb30dc04ea89d831a48984b7364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:13Z,use_quota=True,user_id='7ae2774088804ea68f214b4b01b0d8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Creating volume 10ad2800-782c-4639-8676-3e44f6c575e5 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:12 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:23:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-10ad2800-782c-4639-8676-3e44f6c575e5 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:12 devstack sudo[87817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-10ad2800-782c-4639-8676-3e44f6c575e5 1073741824
Apr 28 02:23:12 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:13 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-10ad2800-782c-4639-8676-3e44f6c575e5 1073741824" returned: 0 in 0.764s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-10ad2800-782c-4639-8676-3e44f6c575e5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:13 devstack sudo[87823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-10ad2800-782c-4639-8676-3e44f6c575e5
Apr 28 02:23:13 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:14 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-10ad2800-782c-4639-8676-3e44f6c575e5" returned: 0 in 0.576s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4431c93-275b-44d2-85ba-4aa6b1928a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10ad2800-782c-4639-8676-3e44f6c575e5', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12cfc4d-390d-492f-8140-2e0d926a16d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:14 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Volume volume-10ad2800-782c-4639-8676-3e44f6c575e5 (10ad2800-782c-4639-8676-3e44f6c575e5): created successfully
Apr 28 02:23:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12cfc4d-390d-492f-8140-2e0d926a16d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Flow 'volume_create_manager' (248ddfc3-ad36-45d6-9b00-39d5af4a84c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:14 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-34772990-4d9a-49e5-b6a8-1b324fbad297 tempest-VolumesListAdminTestJSON-1685300913 None] Created volume successfully.
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Flow 'volume_create_manager' (bd1587a1-ecd9-4e70-83d4-50ca6c1ed33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a135733a-d965-4ec8-8cd2-e10ca24641fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a135733a-d965-4ec8-8cd2-e10ca24641fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1418832616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b253b9ea-1563-4f42-9a81-8131d6b9784a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e1afb30dc04ea89d831a48984b7364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:15Z,use_quota=True,user_id='7ae2774088804ea68f214b4b01b0d8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d8f05d-99e2-4b07-aad2-0784d276f278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d8f05d-99e2-4b07-aad2-0784d276f278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2b299d-a447-457c-84b3-72041888101a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2b299d-a447-457c-84b3-72041888101a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b253b9ea-1563-4f42-9a81-8131d6b9784a', 'volume_name': 'volume-b253b9ea-1563-4f42-9a81-8131d6b9784a', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1c8e2f-e4fb-4968-aba9-b638254f0612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1c8e2f-e4fb-4968-aba9-b638254f0612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6154c35e-0076-4844-b8b9-4516a32a4dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:15 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Volume b253b9ea-1563-4f42-9a81-8131d6b9784a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b253b9ea-1563-4f42-9a81-8131d6b9784a', 'volume_size': 1}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1418832616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b253b9ea-1563-4f42-9a81-8131d6b9784a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e1afb30dc04ea89d831a48984b7364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:15Z,use_quota=True,user_id='7ae2774088804ea68f214b4b01b0d8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Creating volume b253b9ea-1563-4f42-9a81-8131d6b9784a {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:15 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:23:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b253b9ea-1563-4f42-9a81-8131d6b9784a 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:15 devstack sudo[87828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b253b9ea-1563-4f42-9a81-8131d6b9784a 1073741824
Apr 28 02:23:15 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:16 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b253b9ea-1563-4f42-9a81-8131d6b9784a 1073741824" returned: 0 in 0.734s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b253b9ea-1563-4f42-9a81-8131d6b9784a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:16 devstack sudo[87833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b253b9ea-1563-4f42-9a81-8131d6b9784a
Apr 28 02:23:16 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:16 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b253b9ea-1563-4f42-9a81-8131d6b9784a" returned: 0 in 0.470s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6154c35e-0076-4844-b8b9-4516a32a4dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b253b9ea-1563-4f42-9a81-8131d6b9784a', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7f953d-19ba-4580-a9de-37756b074588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:16 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Volume volume-b253b9ea-1563-4f42-9a81-8131d6b9784a (b253b9ea-1563-4f42-9a81-8131d6b9784a): created successfully
Apr 28 02:23:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7f953d-19ba-4580-a9de-37756b074588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Flow 'volume_create_manager' (bd1587a1-ecd9-4e70-83d4-50ca6c1ed33e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:16 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3a9f0e95-b24f-4639-a0f9-8373d81d7759 tempest-VolumesListAdminTestJSON-1685300913 None] Created volume successfully.
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Flow 'volume_create_manager' (e5e7de27-2dfd-4957-b9e5-4aeca6f1203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8734a5-e5ee-47a4-83e7-20d2061fe699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef8734a5-e5ee-47a4-83e7-20d2061fe699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-228957136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa3eb41-6f67-4d8f-834b-c791acac2aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e1afb30dc04ea89d831a48984b7364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:18Z,use_quota=True,user_id='7ae2774088804ea68f214b4b01b0d8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a6b771-42ba-482d-b6be-6e2fc20cf65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84a6b771-42ba-482d-b6be-6e2fc20cf65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e829627b-fd5e-45ec-8957-8130f84266d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e829627b-fd5e-45ec-8957-8130f84266d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa3eb41-6f67-4d8f-834b-c791acac2aa1', 'volume_name': 'volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b986e0-57f0-4499-8aeb-c606dc290aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b986e0-57f0-4499-8aeb-c606dc290aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8b4840-c63c-4a07-a105-e421f24c1e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:17 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Volume 2fa3eb41-6f67-4d8f-834b-c791acac2aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1', 'volume_size': 1}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-228957136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa3eb41-6f67-4d8f-834b-c791acac2aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e1afb30dc04ea89d831a48984b7364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:18Z,use_quota=True,user_id='7ae2774088804ea68f214b4b01b0d8a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Creating volume 2fa3eb41-6f67-4d8f-834b-c791acac2aa1 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:17 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:23:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:18 devstack sudo[87837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1 1073741824
Apr 28 02:23:18 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Flow 'volume_create_manager' (197c24d1-60a9-4ba7-b86b-cb8ea40c4402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbf3cd1-2f78-42bb-aa5e-c66230064d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbf3cd1-2f78-42bb-aa5e-c66230064d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1554240482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11ee6d9-7eef-454a-9545-51686ef813ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1abaaaf09a354c789a385557aa382fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:18Z,use_quota=True,user_id='d4b72139124c4844a85e6708eed4611f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f9c500-5392-4cfa-89d6-1d73e91c0644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f9c500-5392-4cfa-89d6-1d73e91c0644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8b935c-674f-4b5d-9a6d-10eb46b9401e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8b935c-674f-4b5d-9a6d-10eb46b9401e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11ee6d9-7eef-454a-9545-51686ef813ec', 'volume_name': 'volume-c11ee6d9-7eef-454a-9545-51686ef813ec', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fbd822-7029-4af2-91ea-32dcb9facf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09fbd822-7029-4af2-91ea-32dcb9facf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfdef40-6fee-41c1-8378-8a53fe782c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:18 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Volume c11ee6d9-7eef-454a-9545-51686ef813ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11ee6d9-7eef-454a-9545-51686ef813ec', 'volume_size': 1}
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:18 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1 1073741824" returned: 0 in 0.756s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:18 devstack sudo[87842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1
Apr 28 02:23:18 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:19 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1" returned: 0 in 0.479s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1554240482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11ee6d9-7eef-454a-9545-51686ef813ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1abaaaf09a354c789a385557aa382fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:18Z,use_quota=True,user_id='d4b72139124c4844a85e6708eed4611f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Creating volume c11ee6d9-7eef-454a-9545-51686ef813ec {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:19 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c11ee6d9-7eef-454a-9545-51686ef813ec 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8b4840-c63c-4a07-a105-e421f24c1e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95178f5-37b3-47e3-bc06-263f33f1ce40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:19 devstack sudo[87845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c11ee6d9-7eef-454a-9545-51686ef813ec 1073741824
Apr 28 02:23:19 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:19 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Volume volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1 (2fa3eb41-6f67-4d8f-834b-c791acac2aa1): created successfully
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95178f5-37b3-47e3-bc06-263f33f1ce40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Flow 'volume_create_manager' (e5e7de27-2dfd-4957-b9e5-4aeca6f1203a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:19 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ac0008bc-c913-49cf-a1c6-1888398cb1f5 tempest-VolumesListAdminTestJSON-1685300913 None] Created volume successfully.
Apr 28 02:23:19 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c11ee6d9-7eef-454a-9545-51686ef813ec 1073741824" returned: 0 in 0.674s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c11ee6d9-7eef-454a-9545-51686ef813ec {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:19 devstack sudo[87850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c11ee6d9-7eef-454a-9545-51686ef813ec
Apr 28 02:23:19 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:20 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c11ee6d9-7eef-454a-9545-51686ef813ec" returned: 0 in 0.623s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfdef40-6fee-41c1-8378-8a53fe782c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11ee6d9-7eef-454a-9545-51686ef813ec', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebad760-adac-49a8-b0a4-bd68a0ba04a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:20 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Volume volume-c11ee6d9-7eef-454a-9545-51686ef813ec (c11ee6d9-7eef-454a-9545-51686ef813ec): created successfully
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebad760-adac-49a8-b0a4-bd68a0ba04a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Flow 'volume_create_manager' (197c24d1-60a9-4ba7-b86b-cb8ea40c4402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:20 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-32df0033-9dd6-4016-9abe-b79eac76e423 tempest-VolumesActionsTest-222740078 None] Created volume successfully.
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Flow 'volume_create_manager' (55b871b3-9c92-4ecb-8913-e168f90e16f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7050838-dbdc-4010-bc2e-6c8c44cebfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7050838-dbdc-4010-bc2e-6c8c44cebfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8702f64-5d0f-4622-a556-b6d37ccac924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c66591716bc45989e441f616d0391f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:21Z,use_quota=True,user_id='15398e142e38415e93af47159ae43fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b06045c-ae10-4708-81dd-39872fe3eff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b06045c-ae10-4708-81dd-39872fe3eff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e379407-80f6-4595-9b5a-d38939615ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e379407-80f6-4595-9b5a-d38939615ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8702f64-5d0f-4622-a556-b6d37ccac924', 'volume_name': 'volume-d8702f64-5d0f-4622-a556-b6d37ccac924', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbd2033-5b73-436a-8769-1df5aee10e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbd2033-5b73-436a-8769-1df5aee10e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e53cba7-7bd6-44a3-b827-8d8b0baca5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:20 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Volume d8702f64-5d0f-4622-a556-b6d37ccac924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8702f64-5d0f-4622-a556-b6d37ccac924', 'volume_size': 1}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8702f64-5d0f-4622-a556-b6d37ccac924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c66591716bc45989e441f616d0391f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:21Z,use_quota=True,user_id='15398e142e38415e93af47159ae43fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Creating volume d8702f64-5d0f-4622-a556-b6d37ccac924 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:20 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:23:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8702f64-5d0f-4622-a556-b6d37ccac924 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:20 devstack sudo[87853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8702f64-5d0f-4622-a556-b6d37ccac924 1073741824
Apr 28 02:23:20 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:21 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8702f64-5d0f-4622-a556-b6d37ccac924 1073741824" returned: 0 in 0.646s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8702f64-5d0f-4622-a556-b6d37ccac924 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:21 devstack sudo[87865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8702f64-5d0f-4622-a556-b6d37ccac924
Apr 28 02:23:21 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:21 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Acquiring lock "cinder-c11ee6d9-7eef-454a-9545-51686ef813ec-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:21 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Lock "cinder-c11ee6d9-7eef-454a-9545-51686ef813ec-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:21 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Acquiring lock "cinder-quobyte-c11ee6d9-7eef-454a-9545-51686ef813ec" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:21 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Lock "cinder-quobyte-c11ee6d9-7eef-454a-9545-51686ef813ec" acquired by "delete_volume" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:21 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[66175bf6-ede2-4063-8f4b-74baa12f5f73]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c11ee6d9-7eef-454a-9545-51686ef813ec {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:22 devstack sudo[87868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c11ee6d9-7eef-454a-9545-51686ef813ec
Apr 28 02:23:22 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:22 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8702f64-5d0f-4622-a556-b6d37ccac924" returned: 0 in 0.607s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e53cba7-7bd6-44a3-b827-8d8b0baca5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8702f64-5d0f-4622-a556-b6d37ccac924', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66352dad-d640-42c6-9733-0ecbcd118503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:22 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Volume volume-d8702f64-5d0f-4622-a556-b6d37ccac924 (d8702f64-5d0f-4622-a556-b6d37ccac924): created successfully
Apr 28 02:23:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66352dad-d640-42c6-9733-0ecbcd118503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Flow 'volume_create_manager' (55b871b3-9c92-4ecb-8913-e168f90e16f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:22 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ca342fe4-ceb0-4160-8e27-a7b78f58df8a tempest-VolumesListAdminTestJSON-47313218 None] Created volume successfully.
Apr 28 02:23:22 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c11ee6d9-7eef-454a-9545-51686ef813ec" returned: 0 in 0.624s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c11ee6d9-7eef-454a-9545-51686ef813ec {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:22 devstack sudo[87874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c11ee6d9-7eef-454a-9545-51686ef813ec
Apr 28 02:23:22 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Acquiring lock "cinder-d8702f64-5d0f-4622-a556-b6d37ccac924-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Lock "cinder-d8702f64-5d0f-4622-a556-b6d37ccac924-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Acquiring lock "cinder-quobyte-d8702f64-5d0f-4622-a556-b6d37ccac924" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Lock "cinder-quobyte-d8702f64-5d0f-4622-a556-b6d37ccac924" acquired by "delete_volume" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1390a7bf-d4a8-4b60-913e-81bcbd603740]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8702f64-5d0f-4622-a556-b6d37ccac924 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:23 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c11ee6d9-7eef-454a-9545-51686ef813ec" returned: 0 in 0.793s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Lock "cinder-quobyte-c11ee6d9-7eef-454a-9545-51686ef813ec" released by "delete_volume" :: held 1.479s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Created reservations ['59372b39-fb74-4843-9f06-e4056cfb6906', 'de6451bc-6216-498a-969f-eaba25e8fe15', '10ca5610-306e-4b4f-9037-f10cc70f7aa3', '7bab67db-2ef4-4c75-8ef2-53dc042102cd'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "cinder-2fa3eb41-6f67-4d8f-834b-c791acac2aa1-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:23 devstack sudo[87877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8702f64-5d0f-4622-a556-b6d37ccac924
Apr 28 02:23:23 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "cinder-2fa3eb41-6f67-4d8f-834b-c791acac2aa1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "cinder-quobyte-2fa3eb41-6f67-4d8f-834b-c791acac2aa1" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:23 devstack sudo[87879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "cinder-quobyte-2fa3eb41-6f67-4d8f-834b-c791acac2aa1" acquired by "delete_volume" :: waited 0.038s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:23 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1e3961-1591-46b8-801a-faf982cbee95]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:23 devstack sudo[87881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1
Apr 28 02:23:23 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:24 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8702f64-5d0f-4622-a556-b6d37ccac924" returned: 0 in 0.727s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8702f64-5d0f-4622-a556-b6d37ccac924 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:24 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8702f64-5d0f-4622-a556-b6d37ccac924
Apr 28 02:23:24 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:24 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Flow 'volume_create_manager' (166014c8-cce5-41b2-9936-64e2e5f389c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ec6215-8ccd-4ac0-879e-34b77acac869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.615s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ec6215-8ccd-4ac0-879e-34b77acac869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-979244762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f654a98c-96e6-4231-baa9-5a51e1a48bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506b570f1816485fb273e58d9943336a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:24Z,use_quota=True,user_id='604dc75a23a44f24a339c18012fa53a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ddcbb0-48bf-423e-9fde-5b84e6a23d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ddcbb0-48bf-423e-9fde-5b84e6a23d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e43c11-f192-4d34-be09-d2d888098631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e43c11-f192-4d34-be09-d2d888098631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f654a98c-96e6-4231-baa9-5a51e1a48bc0', 'volume_name': 'volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16000374-2fec-4a3f-af01-b5adfe70552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16000374-2fec-4a3f-af01-b5adfe70552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a112e50-4b99-4d79-93d2-93aff6313be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:24 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Volume f654a98c-96e6-4231-baa9-5a51e1a48bc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0', 'volume_size': 1}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-979244762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f654a98c-96e6-4231-baa9-5a51e1a48bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506b570f1816485fb273e58d9943336a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:24Z,use_quota=True,user_id='604dc75a23a44f24a339c18012fa53a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Creating volume f654a98c-96e6-4231-baa9-5a51e1a48bc0 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:24 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:24 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Deleted volume successfully.
Apr 28 02:23:24 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1" returned: 0 in 0.660s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:24 devstack sudo[87892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 1073741824
Apr 28 02:23:24 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-698c696b-eb05-47dc-9542-52b04188dc21 tempest-VolumesActionsTest-55382510 None] Lock "cinder-c11ee6d9-7eef-454a-9545-51686ef813ec-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:24 devstack sudo[87894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1
Apr 28 02:23:24 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Flow 'volume_create_manager' (b609c6b1-9912-4b98-8ec3-c2718e1d9a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcad578-5803-418a-8e89-c33d098c8dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebcad578-5803-418a-8e89-c33d098c8dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-226483240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28457a90-848e-4126-83ac-1edd79e28fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1abaaaf09a354c789a385557aa382fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:24Z,use_quota=True,user_id='d4b72139124c4844a85e6708eed4611f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c056698c-bc61-4f75-abb4-df7994ebcd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c056698c-bc61-4f75-abb4-df7994ebcd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b15754-86c6-42ae-a675-90c2ab2261f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b15754-86c6-42ae-a675-90c2ab2261f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28457a90-848e-4126-83ac-1edd79e28fe5', 'volume_name': 'volume-28457a90-848e-4126-83ac-1edd79e28fe5', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca2b654-ec4a-4bea-8ff2-6d000c2d1f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca2b654-ec4a-4bea-8ff2-6d000c2d1f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:24 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c961bf4a-dd68-4f72-9812-8722988841fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:24 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Volume 28457a90-848e-4126-83ac-1edd79e28fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28457a90-848e-4126-83ac-1edd79e28fe5', 'volume_size': 1}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8702f64-5d0f-4622-a556-b6d37ccac924" returned: 0 in 0.614s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Lock "cinder-quobyte-d8702f64-5d0f-4622-a556-b6d37ccac924" released by "delete_volume" :: held 1.391s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Created reservations ['3fada86c-d459-42dc-8f17-4fc5142bcfb0', '37d45b04-699b-4c1c-9443-39ea946485a3', '49d9b1aa-1bfa-4aa8-871c-f0d9e39c7249', '9aec0728-f4f3-49c8-b288-1d5515eb07a5'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:24 devstack sudo[87899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:24 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:24 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fa3eb41-6f67-4d8f-834b-c791acac2aa1" returned: 0 in 0.608s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "cinder-quobyte-2fa3eb41-6f67-4d8f-834b-c791acac2aa1" released by "delete_volume" :: held 1.314s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:24 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Created reservations ['8253e6cb-241d-49a2-a5e0-8dbe8f2a9577', '4798ddfd-32bc-4d60-b128-415c04b9c10f', 'de2af48f-d9e6-4a13-a453-24ca118b7ef5', '764a33b8-e9f2-47ae-a7af-7ed443aa78f1'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:25 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 1073741824" returned: 0 in 0.781s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:25 devstack sudo[87903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:25 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:25 devstack sudo[87904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0
Apr 28 02:23:25 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:25 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.486s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:25 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Deleted volume successfully.
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0c033419-b9ff-48dc-9002-500950a03842 tempest-VolumesListAdminTestJSON-47313218 None] Lock "cinder-d8702f64-5d0f-4622-a556-b6d37ccac924-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:25 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0" returned: 0 in 0.458s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:25 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.882s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-226483240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28457a90-848e-4126-83ac-1edd79e28fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1abaaaf09a354c789a385557aa382fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:24Z,use_quota=True,user_id='d4b72139124c4844a85e6708eed4611f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Creating volume 28457a90-848e-4126-83ac-1edd79e28fe5 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:25 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-28457a90-848e-4126-83ac-1edd79e28fe5 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.506s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:25 devstack sudo[87910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-28457a90-848e-4126-83ac-1edd79e28fe5 1073741824
Apr 28 02:23:25 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a112e50-4b99-4d79-93d2-93aff6313be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cdd01a-0394-4297-a446-6745041e7678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:25 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Deleted volume successfully.
Apr 28 02:23:25 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Volume volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 (f654a98c-96e6-4231-baa9-5a51e1a48bc0): created successfully
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cdd01a-0394-4297-a446-6745041e7678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Flow 'volume_create_manager' (166014c8-cce5-41b2-9936-64e2e5f389c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c5294bfc-077f-4f19-9c13-1abd5ce13c93 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "cinder-2fa3eb41-6f67-4d8f-834b-c791acac2aa1-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:25 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2ed90ce6-6c70-4a6c-aa3b-c3b90efba400 tempest-SnapshotDependencyTests-45865748 None] Created volume successfully.
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "cinder-b253b9ea-1563-4f42-9a81-8131d6b9784a-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "cinder-b253b9ea-1563-4f42-9a81-8131d6b9784a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "cinder-quobyte-b253b9ea-1563-4f42-9a81-8131d6b9784a" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "cinder-quobyte-b253b9ea-1563-4f42-9a81-8131d6b9784a" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37521b9-e1c8-413c-83b2-f5706c0ccbaf]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b253b9ea-1563-4f42-9a81-8131d6b9784a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:25 devstack sudo[87912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b253b9ea-1563-4f42-9a81-8131d6b9784a
Apr 28 02:23:25 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-28457a90-848e-4126-83ac-1edd79e28fe5 1073741824" returned: 0 in 0.645s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:26 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-28457a90-848e-4126-83ac-1edd79e28fe5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:26 devstack sudo[87917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-28457a90-848e-4126-83ac-1edd79e28fe5
Apr 28 02:23:26 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:26 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b253b9ea-1563-4f42-9a81-8131d6b9784a" returned: 0 in 0.579s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b253b9ea-1563-4f42-9a81-8131d6b9784a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:26 devstack sudo[87922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b253b9ea-1563-4f42-9a81-8131d6b9784a
Apr 28 02:23:26 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:26 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-28457a90-848e-4126-83ac-1edd79e28fe5" returned: 0 in 0.529s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.256s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] Creating offline snapshot fb1be03e-b9d2-421e-b4eb-740e364ad386 of volume f654a98c-96e6-4231-baa9-5a51e1a48bc0 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c961bf4a-dd68-4f72-9812-8722988841fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28457a90-848e-4126-83ac-1edd79e28fe5', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc2211e-f5e8-4cff-97aa-4e195a98ff35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f142db-73b3-4c0a-97ca-22cea677dac9]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:26 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Volume volume-28457a90-848e-4126-83ac-1edd79e28fe5 (28457a90-848e-4126-83ac-1edd79e28fe5): created successfully
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc2211e-f5e8-4cff-97aa-4e195a98ff35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Flow 'volume_create_manager' (b609c6b1-9912-4b98-8ec3-c2718e1d9a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:26 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a7a1b27a-c88b-4c45-ac96-c9cedfa7bad8 tempest-VolumesActionsTest-222740078 None] Created volume successfully.
Apr 28 02:23:26 devstack sudo[87925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0
Apr 28 02:23:26 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:26 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b253b9ea-1563-4f42-9a81-8131d6b9784a" returned: 0 in 0.496s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "cinder-quobyte-b253b9ea-1563-4f42-9a81-8131d6b9784a" released by "delete_volume" :: held 1.125s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:26 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Created reservations ['c125552b-0188-4f02-b5d9-efbb3a6cf3f8', '5947a33d-5b57-4f8d-9d7f-5770018f170c', '57f373b6-36e0-4c69-8253-29fbc20884a3', '210d4822-fa5b-4452-8b9c-f5dc483182e5'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:27 devstack sudo[87929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:27 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:27 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0" returned: 0 in 0.537s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:27 devstack sudo[87934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386 1G
Apr 28 02:23:27 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:27 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.432s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:27 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:27 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Deleted volume successfully.
Apr 28 02:23:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b572dd90-b715-44c1-8288-fd8c50f8ad68 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "cinder-b253b9ea-1563-4f42-9a81-8131d6b9784a-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:27 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386 1G" returned: 0 in 0.624s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:28 devstack sudo[87942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386
Apr 28 02:23:28 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Acquiring lock "cinder-28457a90-848e-4126-83ac-1edd79e28fe5-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Lock "cinder-28457a90-848e-4126-83ac-1edd79e28fe5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Acquiring lock "cinder-quobyte-28457a90-848e-4126-83ac-1edd79e28fe5" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Lock "cinder-quobyte-28457a90-848e-4126-83ac-1edd79e28fe5" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "cinder-10ad2800-782c-4639-8676-3e44f6c575e5-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e57ea75-f69d-4e16-82f8-55c59cfcc89d]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-28457a90-848e-4126-83ac-1edd79e28fe5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "cinder-10ad2800-782c-4639-8676-3e44f6c575e5-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "cinder-quobyte-10ad2800-782c-4639-8676-3e44f6c575e5" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "cinder-quobyte-10ad2800-782c-4639-8676-3e44f6c575e5" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:28 devstack sudo[87944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-28457a90-848e-4126-83ac-1edd79e28fe5
Apr 28 02:23:28 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[326ca1b1-4429-4769-9197-7c26c72249d1]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-10ad2800-782c-4639-8676-3e44f6c575e5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:28 devstack sudo[87946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-10ad2800-782c-4639-8676-3e44f6c575e5
Apr 28 02:23:28 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:28 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386" returned: 0 in 0.576s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:28 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386 is being set with open permissions: ugo+rw
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:28 devstack sudo[87951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386
Apr 28 02:23:28 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:28 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-28457a90-848e-4126-83ac-1edd79e28fe5" returned: 0 in 0.599s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-28457a90-848e-4126-83ac-1edd79e28fe5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:28 devstack sudo[87959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-28457a90-848e-4126-83ac-1edd79e28fe5
Apr 28 02:23:28 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:28 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-10ad2800-782c-4639-8676-3e44f6c575e5" returned: 0 in 0.582s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-10ad2800-782c-4639-8676-3e44f6c575e5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:28 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-10ad2800-782c-4639-8676-3e44f6c575e5
Apr 28 02:23:28 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:29 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386" returned: 0 in 0.464s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:29 devstack sudo[87964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.info
Apr 28 02:23:29 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:29 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-28457a90-848e-4126-83ac-1edd79e28fe5" returned: 0 in 0.452s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Lock "cinder-quobyte-28457a90-848e-4126-83ac-1edd79e28fe5" released by "delete_volume" :: held 1.110s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Created reservations ['b5b58d53-f7c7-466b-a9ab-7b6563c38677', '59900dff-62fd-402d-8ff3-6452c08b8ab4', '9ff5dd09-98b9-4ffa-9d9b-bd71fe6bbc38', '23e20dc2-2e8a-4d2d-aace-b31b37a03d0e'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:29 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-10ad2800-782c-4639-8676-3e44f6c575e5" returned: 0 in 0.480s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "cinder-quobyte-10ad2800-782c-4639-8676-3e44f6c575e5" released by "delete_volume" :: held 1.127s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:29 devstack sudo[87968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:29 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Created reservations ['d61692e6-d067-4120-bde5-2b4ae8ec5ad3', '8e0104d0-d4b7-40a1-8d2d-5660764dbc58', 'a0bced3d-453a-44a2-85bf-6a58a271b503', '37323ee2-0e82-4b8b-bf3c-6d4be1a1301c'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:29 devstack sudo[87971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:29 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:29 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.info" returned: 0 in 0.472s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:29 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.info is being set with open permissions: ugo+rw
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:29 devstack sudo[87973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.info
Apr 28 02:23:29 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:29 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.453s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:29 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Deleted volume successfully.
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a56af3ee-1026-41fa-8205-678efbe46c1c tempest-VolumesActionsTest-55382510 None] Lock "cinder-28457a90-848e-4126-83ac-1edd79e28fe5-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:29 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.460s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:29 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Deleted volume successfully.
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3efd0e5d-ad55-48db-a9b6-fac8589274a1 tempest-VolumesListAdminTestJSON-1685300913 None] Lock "cinder-10ad2800-782c-4639-8676-3e44f6c575e5-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:29 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.info" returned: 0 in 0.448s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.213s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:30 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2dc14f1d-d597-4b2f-bd47-419c155ee9d9 tempest-SnapshotDependencyTests-45865748 None] Create snapshot completed successfully
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Flow 'volume_create_manager' (2276b4b1-a43c-42bf-9adf-91f449eee985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601fb7b5-2a60-486e-b5ca-200258ed9872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601fb7b5-2a60-486e-b5ca-200258ed9872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-455520492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b092f6-42f5-46d8-900f-ad63aa30be06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1abaaaf09a354c789a385557aa382fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:31Z,use_quota=True,user_id='d4b72139124c4844a85e6708eed4611f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ce4549-c77d-4060-bfae-efff89039c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3ce4549-c77d-4060-bfae-efff89039c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde92b1c-256c-4ccb-9b01-061e6de33e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde92b1c-256c-4ccb-9b01-061e6de33e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9b092f6-42f5-46d8-900f-ad63aa30be06', 'volume_name': 'volume-b9b092f6-42f5-46d8-900f-ad63aa30be06', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5a5672-2261-46fa-88b5-3d06fdda94de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5a5672-2261-46fa-88b5-3d06fdda94de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd6f659-6497-4e57-b7b7-60fa2454446a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:30 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Volume b9b092f6-42f5-46d8-900f-ad63aa30be06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9b092f6-42f5-46d8-900f-ad63aa30be06', 'volume_size': 1}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-455520492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b092f6-42f5-46d8-900f-ad63aa30be06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1abaaaf09a354c789a385557aa382fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:31Z,use_quota=True,user_id='d4b72139124c4844a85e6708eed4611f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Creating volume b9b092f6-42f5-46d8-900f-ad63aa30be06 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:30 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:23:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9b092f6-42f5-46d8-900f-ad63aa30be06 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:30 devstack sudo[87978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9b092f6-42f5-46d8-900f-ad63aa30be06 1073741824
Apr 28 02:23:30 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Flow 'volume_create_manager' (e533af37-acae-485d-bde8-ef8c171d4ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccba5cd6-7876-411e-94bc-2dc3f2f18fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccba5cd6-7876-411e-94bc-2dc3f2f18fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3990d887-95e6-4b99-af1d-4408192928d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506b570f1816485fb273e58d9943336a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fb1be03e-b9d2-421e-b4eb-740e364ad386,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:31Z,use_quota=True,user_id='604dc75a23a44f24a339c18012fa53a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d211bb-0801-44ad-aa6b-6692e3046529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d211bb-0801-44ad-aa6b-6692e3046529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23a3160-98db-478f-9eb7-f5ba930c85b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23a3160-98db-478f-9eb7-f5ba930c85b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3990d887-95e6-4b99-af1d-4408192928d0', 'volume_name': 'volume-3990d887-95e6-4b99-af1d-4408192928d0', 'volume_size': 1, 'snapshot_id': 'fb1be03e-b9d2-421e-b4eb-740e364ad386'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84143319-5600-4fad-bfec-b782f38772b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84143319-5600-4fad-bfec-b782f38772b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a758d740-78bd-4f63-a0bc-9ddad7726596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:31 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Volume 3990d887-95e6-4b99-af1d-4408192928d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3990d887-95e6-4b99-af1d-4408192928d0', 'volume_size': 1, 'snapshot_id': 'fb1be03e-b9d2-421e-b4eb-740e364ad386'}
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:31 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9b092f6-42f5-46d8-900f-ad63aa30be06 1073741824" returned: 0 in 0.750s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9b092f6-42f5-46d8-900f-ad63aa30be06 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:31 devstack sudo[87983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9b092f6-42f5-46d8-900f-ad63aa30be06
Apr 28 02:23:31 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:32 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9b092f6-42f5-46d8-900f-ad63aa30be06" returned: 0 in 0.559s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.708s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "cinder-quobyte-fb1be03e-b9d2-421e-b4eb-740e364ad386-3990d887-95e6-4b99-af1d-4408192928d0" by "_create_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbd6f659-6497-4e57-b7b7-60fa2454446a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9b092f6-42f5-46d8-900f-ad63aa30be06', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76fcf1e-c1a8-4b32-bee8-bbf70ddfc77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:32 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Volume volume-b9b092f6-42f5-46d8-900f-ad63aa30be06 (b9b092f6-42f5-46d8-900f-ad63aa30be06): created successfully
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76fcf1e-c1a8-4b32-bee8-bbf70ddfc77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Flow 'volume_create_manager' (2276b4b1-a43c-42bf-9adf-91f449eee985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-quobyte-fb1be03e-b9d2-421e-b4eb-740e364ad386-3990d887-95e6-4b99-af1d-4408192928d0" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Creating volume 3990d887-95e6-4b99-af1d-4408192928d0 from snapshot fb1be03e-b9d2-421e-b4eb-740e364ad386 {{(pid=81489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "cinder-quobyte-3990d887-95e6-4b99-af1d-4408192928d0" by "_copy_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:32 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-0c60885e-79da-4bf8-975b-88f4c1cd2145 tempest-VolumesActionsTest-222740078 None] Created volume successfully.
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-quobyte-3990d887-95e6-4b99-af1d-4408192928d0" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] snapshot: fb1be03e-b9d2-421e-b4eb-740e364ad386, volume: 3990d887-95e6-4b99-af1d-4408192928d0,  {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7c6c7d-2dc7-44ef-a0ee-d9603ebdfb3e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:32 devstack sudo[87986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386
Apr 28 02:23:32 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:32 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386" returned: 0 in 0.637s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Creating direct copy from snapshot {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8103c58-4678-41ce-9b9f-2dfca001fd36]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Acquiring lock "cinder-b9b092f6-42f5-46d8-900f-ad63aa30be06-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Lock "cinder-b9b092f6-42f5-46d8-900f-ad63aa30be06-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Acquiring lock "cinder-quobyte-b9b092f6-42f5-46d8-900f-ad63aa30be06" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Lock "cinder-quobyte-b9b092f6-42f5-46d8-900f-ad63aa30be06" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b5db68-d4eb-4561-8abf-71093cedc965]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9b092f6-42f5-46d8-900f-ad63aa30be06 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:32 devstack sudo[87991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0
Apr 28 02:23:32 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:33 devstack sudo[87993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9b092f6-42f5-46d8-900f-ad63aa30be06
Apr 28 02:23:33 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:33 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0" returned: 0 in 0.609s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:33 devstack cinder-volume[81489]: DEBUG cinder.utils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Path /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0 not found in is_blk_device check {{(pid=81489) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 02:23:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:33 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0
Apr 28 02:23:33 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:33 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9b092f6-42f5-46d8-900f-ad63aa30be06" returned: 0 in 0.595s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9b092f6-42f5-46d8-900f-ad63aa30be06 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:33 devstack sudo[88003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9b092f6-42f5-46d8-900f-ad63aa30be06
Apr 28 02:23:33 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:33 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:33 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Flow 'volume_create_manager' (4f87fa03-b59c-43a1-9f4c-b8544a34426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:33 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344039a8-dfdb-4103-ba78-5e7f1fc567b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:33 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (344039a8-dfdb-4103-ba78-5e7f1fc567b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1638190112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624baad1-3d58-44c1-b12f-108899238aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7e4071bc8f464b93ed949b9262e732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:34Z,use_quota=True,user_id='b90f9873a926489b8ae8f00a5b24ddfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:33 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566bb9fb-c6a2-42eb-8457-f86abae97de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:33 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566bb9fb-c6a2-42eb-8457-f86abae97de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:33 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94edc072-2b2a-488c-a212-31e0745282ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:33 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94edc072-2b2a-488c-a212-31e0745282ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '624baad1-3d58-44c1-b12f-108899238aa4', 'volume_name': 'volume-624baad1-3d58-44c1-b12f-108899238aa4', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d77fbc-70f5-4c37-8e8e-d11e6208d6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d77fbc-70f5-4c37-8e8e-d11e6208d6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db916dc1-8aa9-4573-9f20-2437ec178cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:34 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Volume 624baad1-3d58-44c1-b12f-108899238aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-624baad1-3d58-44c1-b12f-108899238aa4', 'volume_size': 1}
Apr 28 02:23:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:34 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9b092f6-42f5-46d8-900f-ad63aa30be06" returned: 0 in 0.516s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:34 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Lock "cinder-quobyte-b9b092f6-42f5-46d8-900f-ad63aa30be06" released by "delete_volume" :: held 1.150s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:34 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Created reservations ['6908e59f-b2a7-4bc4-8d2c-f4bb26ce60e4', '19d007ab-f168-46f9-8a88-261348634643', '62f6ba93-8d4d-4753-856b-09349aeeed6b', '4be3fb65-5bf2-44ad-8ed3-33db786e3cf1'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:34 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:34 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:34 devstack sudo[88016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:34 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:35 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.264s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:35 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:35 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Deleted volume successfully.
Apr 28 02:23:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ea34b794-6ca9-403c-b491-b30fa8ccf968 tempest-VolumesActionsTest-55382510 None] Lock "cinder-b9b092f6-42f5-46d8-900f-ad63aa30be06-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:35 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Flow 'volume_create_manager' (25f04589-1647-4a7e-b142-47c1447cf9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a9450f-a1db-42ff-8854-0c0d371d314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a9450f-a1db-42ff-8854-0c0d371d314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1346486741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a53b09-8031-49cc-a4ca-8584bc182a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1abaaaf09a354c789a385557aa382fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:36Z,use_quota=True,user_id='d4b72139124c4844a85e6708eed4611f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51899c6d-1d66-4ba2-91a8-5a7303dd23fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51899c6d-1d66-4ba2-91a8-5a7303dd23fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd105cd-c1ae-45b1-9c35-58bd36561eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd105cd-c1ae-45b1-9c35-58bd36561eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a53b09-8031-49cc-a4ca-8584bc182a96', 'volume_name': 'volume-d8a53b09-8031-49cc-a4ca-8584bc182a96', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6649352c-3970-4ae5-9e08-a49f51aaaf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6649352c-3970-4ae5-9e08-a49f51aaaf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd09838f-e681-44ce-9292-ea288db3c7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:36 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Volume d8a53b09-8031-49cc-a4ca-8584bc182a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a53b09-8031-49cc-a4ca-8584bc182a96', 'volume_size': 1}
Apr 28 02:23:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:38 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0" returned: 0 in 5.025s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:38 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d893edb3-e4fb-46f6-8d5b-fcabaad6e98d]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:38 devstack sudo[88021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0
Apr 28 02:23:38 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:39 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0" returned: 0 in 0.634s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0 {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:23:39 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Converted 1024.00 MB image at 203.73 MB/s
Apr 28 02:23:39 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0 is being set with open permissions: ugo+rw
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:39 devstack sudo[88026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0
Apr 28 02:23:39 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:39 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0" returned: 0 in 0.455s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-quobyte-3990d887-95e6-4b99-af1d-4408192928d0" released by "_copy_volume_from_snapshot" :: held 7.475s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-quobyte-fb1be03e-b9d2-421e-b4eb-740e364ad386-3990d887-95e6-4b99-af1d-4408192928d0" released by "_create_volume_from_snapshot" :: held 7.518s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.574s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.606s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1638190112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624baad1-3d58-44c1-b12f-108899238aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7e4071bc8f464b93ed949b9262e732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:34Z,use_quota=True,user_id='b90f9873a926489b8ae8f00a5b24ddfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Creating volume 624baad1-3d58-44c1-b12f-108899238aa4 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:39 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:39 devstack sudo[88029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4 1073741824
Apr 28 02:23:39 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a758d740-78bd-4f63-a0bc-9ddad7726596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3990d887-95e6-4b99-af1d-4408192928d0', 'volume_size': 1, 'snapshot_id': 'fb1be03e-b9d2-421e-b4eb-740e364ad386'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63aa89ba-886a-4797-b18c-665c0d988aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:39 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Volume volume-3990d887-95e6-4b99-af1d-4408192928d0 (3990d887-95e6-4b99-af1d-4408192928d0): created successfully
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63aa89ba-886a-4797-b18c-665c0d988aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Flow 'volume_create_manager' (e533af37-acae-485d-bde8-ef8c171d4ca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:39 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3fd14322-50e1-450c-af75-3ff8f066741a tempest-SnapshotDependencyTests-45865748 None] Created volume successfully.
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "cinder-fb1be03e-b9d2-421e-b4eb-740e364ad386-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-fb1be03e-b9d2-421e-b4eb-740e364ad386-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "cinder-quobyte-f654a98c-96e6-4231-baa9-5a51e1a48bc0" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-quobyte-f654a98c-96e6-4231-baa9-5a51e1a48bc0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "cinder-quobyte-fb1be03e-b9d2-421e-b4eb-740e364ad386" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-quobyte-fb1be03e-b9d2-421e-b4eb-740e364ad386" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Deleting offline snapshot fb1be03e-b9d2-421e-b4eb-740e364ad386 of volume f654a98c-96e6-4231-baa9-5a51e1a48bc0 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] snapshot_file for this snap is: volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f803e6b5-df2c-48d9-8584-885426898f4b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:40 devstack sudo[88032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386
Apr 28 02:23:40 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:40 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4 1073741824" returned: 0 in 0.631s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:40 devstack sudo[88036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4
Apr 28 02:23:40 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:40 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386" returned: 0 in 0.592s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7397e213-40ca-45e6-90fc-abaec4fef162]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:40 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0
Apr 28 02:23:40 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:40 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4" returned: 0 in 0.483s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.695s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1346486741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a53b09-8031-49cc-a4ca-8584bc182a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1abaaaf09a354c789a385557aa382fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:36Z,use_quota=True,user_id='d4b72139124c4844a85e6708eed4611f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Creating volume d8a53b09-8031-49cc-a4ca-8584bc182a96 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:40 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8a53b09-8031-49cc-a4ca-8584bc182a96 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:40 devstack sudo[88044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8a53b09-8031-49cc-a4ca-8584bc182a96 1073741824
Apr 28 02:23:40 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db916dc1-8aa9-4573-9f20-2437ec178cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-624baad1-3d58-44c1-b12f-108899238aa4', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b475434a-1cd5-4cc3-87fc-f470fbcb7f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:40 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Volume volume-624baad1-3d58-44c1-b12f-108899238aa4 (624baad1-3d58-44c1-b12f-108899238aa4): created successfully
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b475434a-1cd5-4cc3-87fc-f470fbcb7f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Flow 'volume_create_manager' (4f87fa03-b59c-43a1-9f4c-b8544a34426c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:40 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-29e42256-fc89-4c69-bcfb-c35e0dee01c0 tempest-VolumesDeleteCascade-355588683 None] Created volume successfully.
Apr 28 02:23:41 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0" returned: 0 in 0.514s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:41 devstack sudo[88049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386
Apr 28 02:23:41 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:41 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8a53b09-8031-49cc-a4ca-8584bc182a96 1073741824" returned: 0 in 0.609s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8a53b09-8031-49cc-a4ca-8584bc182a96 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:41 devstack sudo[88054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8a53b09-8031-49cc-a4ca-8584bc182a96
Apr 28 02:23:41 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:41 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386" returned: 0 in 0.637s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:41 devstack sudo[88059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386
Apr 28 02:23:41 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:41 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8a53b09-8031-49cc-a4ca-8584bc182a96" returned: 0 in 0.515s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.068s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd09838f-e681-44ce-9292-ea288db3c7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a53b09-8031-49cc-a4ca-8584bc182a96', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5b0b0a-ef11-4e0d-ae05-31c1171a6d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] Creating offline snapshot aa0a3ccf-e03b-4cff-b69f-f593868c14e8 of volume 624baad1-3d58-44c1-b12f-108899238aa4 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:23:41 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Volume volume-d8a53b09-8031-49cc-a4ca-8584bc182a96 (d8a53b09-8031-49cc-a4ca-8584bc182a96): created successfully
Apr 28 02:23:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5b0b0a-ef11-4e0d-ae05-31c1171a6d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Flow 'volume_create_manager' (25f04589-1647-4a7e-b142-47c1447cf9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7611a0-25ff-4c9f-8a8c-1ffd5b590e51]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:42 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6bb9d598-5c11-47a7-bd02-5dcf516f659b tempest-VolumesActionsTest-222740078 None] Created volume successfully.
Apr 28 02:23:42 devstack sudo[88062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4
Apr 28 02:23:42 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:42 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0.fb1be03e-b9d2-421e-b4eb-740e364ad386" returned: 0 in 0.485s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-quobyte-fb1be03e-b9d2-421e-b4eb-740e364ad386" released by "_delete_snapshot" :: held 2.319s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-quobyte-f654a98c-96e6-4231-baa9-5a51e1a48bc0" released by "delete_snapshot" :: held 2.350s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Created reservations ['53b48864-d5ad-40d1-8c22-040f5ad433e7', '548f84d4-b87d-449d-a831-6a48377a2648', '74e7d60e-55ca-466a-bca1-758262206f60', '8addd1d8-7045-4c54-afaa-16ff4fa82874'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:42 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Delete snapshot completed successfully.
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a527ed9d-2de7-4437-85ba-1c2ddc304113 tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-fb1be03e-b9d2-421e-b4eb-740e364ad386-delete_snapshot" released by "delete_snapshot" :: held 2.482s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:42 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4" returned: 0 in 0.534s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:42 devstack sudo[88068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 1G
Apr 28 02:23:42 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Acquiring lock "cinder-d8a53b09-8031-49cc-a4ca-8584bc182a96-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Lock "cinder-d8a53b09-8031-49cc-a4ca-8584bc182a96-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Acquiring lock "cinder-quobyte-d8a53b09-8031-49cc-a4ca-8584bc182a96" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Lock "cinder-quobyte-d8a53b09-8031-49cc-a4ca-8584bc182a96" acquired by "delete_volume" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[221eb5f1-7b27-460a-8b46-51c7d5bef31a]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8a53b09-8031-49cc-a4ca-8584bc182a96 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:43 devstack sudo[88073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8a53b09-8031-49cc-a4ca-8584bc182a96
Apr 28 02:23:43 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "cinder-f654a98c-96e6-4231-baa9-5a51e1a48bc0-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-f654a98c-96e6-4231-baa9-5a51e1a48bc0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "cinder-quobyte-f654a98c-96e6-4231-baa9-5a51e1a48bc0" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-quobyte-f654a98c-96e6-4231-baa9-5a51e1a48bc0" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:43 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 1G" returned: 0 in 0.687s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624baad1-3d58-44c1-b12f-108899238aa4 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f825e36-9eaf-4720-ad86-bcf65233fd6e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:43 devstack sudo[88075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624baad1-3d58-44c1-b12f-108899238aa4 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8
Apr 28 02:23:43 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:43 devstack sudo[88076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0
Apr 28 02:23:43 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:43 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8a53b09-8031-49cc-a4ca-8584bc182a96" returned: 0 in 0.524s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8a53b09-8031-49cc-a4ca-8584bc182a96 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:43 devstack sudo[88082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8a53b09-8031-49cc-a4ca-8584bc182a96
Apr 28 02:23:43 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:43 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624baad1-3d58-44c1-b12f-108899238aa4 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8" returned: 0 in 0.477s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:43 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 is being set with open permissions: ugo+rw
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:43 devstack sudo[88087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8
Apr 28 02:23:43 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:43 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0" returned: 0 in 0.601s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:43 devstack sudo[88093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0
Apr 28 02:23:43 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:43 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d8a53b09-8031-49cc-a4ca-8584bc182a96" returned: 0 in 0.441s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Lock "cinder-quobyte-d8a53b09-8031-49cc-a4ca-8584bc182a96" released by "delete_volume" :: held 1.012s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:43 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Created reservations ['83bf15a1-469b-4aaf-8fa5-b467e9f6e81a', '2c982c61-f4c9-4e8c-9aaf-789a47b6ac20', 'fd9e0469-8722-4d18-a86f-08466ee71511', '376ce342-585a-4d25-9e18-1367696c6776'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:44 devstack sudo[88095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:44 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:44 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8" returned: 0 in 0.455s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:44 devstack sudo[88098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.info
Apr 28 02:23:44 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:44 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f654a98c-96e6-4231-baa9-5a51e1a48bc0" returned: 0 in 0.523s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-quobyte-f654a98c-96e6-4231-baa9-5a51e1a48bc0" released by "delete_volume" :: held 1.188s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Created reservations ['5851ca9e-1b3f-4a74-b70a-5d569ec932bf', 'de175e00-a58c-4a90-8622-adaff4137374', '64348aa1-27c7-4395-b59a-8e130afd6e22', 'add5e15b-2eb2-493e-a56f-eb7e6d8e91b8'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:44 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.453s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:44 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Deleted volume successfully.
Apr 28 02:23:44 devstack sudo[88102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:44 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-442f657a-e7d3-464b-b181-5943eda7ad22 tempest-VolumesActionsTest-55382510 None] Lock "cinder-d8a53b09-8031-49cc-a4ca-8584bc182a96-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:44 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.info" returned: 0 in 0.488s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:44 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.info is being set with open permissions: ugo+rw
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:44 devstack sudo[88105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.info
Apr 28 02:23:44 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:44 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.436s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:44 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Deleted volume successfully.
Apr 28 02:23:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-af7038c0-ae46-4209-b590-55b1954d8a00 tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-f654a98c-96e6-4231-baa9-5a51e1a48bc0-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:45 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.info" returned: 0 in 0.442s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.204s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:45 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-971bffb8-d12e-408d-88b6-2a5b9fc855fd tempest-VolumesDeleteCascade-355588683 None] Create snapshot completed successfully
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "cinder-3990d887-95e6-4b99-af1d-4408192928d0-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-3990d887-95e6-4b99-af1d-4408192928d0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Flow 'volume_create_manager' (e51190ac-5b08-41b8-967e-8b1f612b8c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6fb9459-d20d-44db-8b5c-50bb9a14f5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6fb9459-d20d-44db-8b5c-50bb9a14f5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-980367312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1abaaaf09a354c789a385557aa382fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:45Z,use_quota=True,user_id='d4b72139124c4844a85e6708eed4611f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db22cffa-f9d8-4b2b-b9f0-01bf4fb9c1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db22cffa-f9d8-4b2b-b9f0-01bf4fb9c1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3c0003-2a9c-4215-8e3d-e800863c028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3c0003-2a9c-4215-8e3d-e800863c028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054', 'volume_name': 'volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571faa48-96ca-4471-ba0c-0cc5565a78b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (571faa48-96ca-4471-ba0c-0cc5565a78b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52d0692-9628-41de-8d9d-2b5870191765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:45 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Volume ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054', 'volume_size': 1}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-980367312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1abaaaf09a354c789a385557aa382fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:45Z,use_quota=True,user_id='d4b72139124c4844a85e6708eed4611f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Creating volume ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:45 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:45 devstack sudo[88109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054 1073741824
Apr 28 02:23:45 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "cinder-quobyte-3990d887-95e6-4b99-af1d-4408192928d0" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-quobyte-3990d887-95e6-4b99-af1d-4408192928d0" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a74eef-5542-4e04-8d6a-7645e25e7d1c]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:45 devstack sudo[88111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0
Apr 28 02:23:45 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:46 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054 1073741824" returned: 0 in 0.613s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:46 devstack sudo[88119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054
Apr 28 02:23:46 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:46 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0" returned: 0 in 0.630s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:46 devstack sudo[88121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0
Apr 28 02:23:46 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:46 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054" returned: 0 in 0.457s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.385s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52d0692-9628-41de-8d9d-2b5870191765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729645a3-8de3-4d9b-b741-afb844b342bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] Creating offline snapshot 46990a64-a8a0-487f-9dac-0e475bc07fc7 of volume 624baad1-3d58-44c1-b12f-108899238aa4 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:23:46 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-3990d887-95e6-4b99-af1d-4408192928d0" returned: 0 in 0.478s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5799e71-89a7-4c1e-bf8e-4ba82ee51570]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-quobyte-3990d887-95e6-4b99-af1d-4408192928d0" released by "delete_volume" :: held 1.155s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:46 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Volume volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054 (ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054): created successfully
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (729645a3-8de3-4d9b-b741-afb844b342bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Flow 'volume_create_manager' (e51190ac-5b08-41b8-967e-8b1f612b8c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:46 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-36889dee-7689-480e-b1fa-103b6e5e29c4 tempest-VolumesActionsTest-222740078 None] Created volume successfully.
Apr 28 02:23:46 devstack sudo[88125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8
Apr 28 02:23:46 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Created reservations ['416b6267-5737-4062-8e16-ff35e523b81c', '9975c193-da4d-4533-9390-fd0961c023d8', 'e1dbc39a-3f94-47f7-906b-19c36ca09dc3', '1b2be473-ae93-46e7-8804-e2e64e6c97e0'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:46 devstack sudo[88127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:46 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:47 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8" returned: 0 in 0.529s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:47 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-624baad1-3d58-44c1-b12f-108899238aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:23:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:47 devstack sudo[88168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7 1G
Apr 28 02:23:47 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:47 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.458s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:47 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:47 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Deleted volume successfully.
Apr 28 02:23:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87eb8d55-5a69-45cf-92d1-487766e0897e tempest-SnapshotDependencyTests-45865748 None] Lock "cinder-3990d887-95e6-4b99-af1d-4408192928d0-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:48 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7 1G" returned: 0 in 0.768s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:48 devstack sudo[88173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7
Apr 28 02:23:48 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Acquiring lock "cinder-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Lock "cinder-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Acquiring lock "cinder-quobyte-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Lock "cinder-quobyte-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054" acquired by "delete_volume" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:48 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0712c635-0a88-40dd-a5e0-f9ed5d1b941e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:48 devstack sudo[88175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054
Apr 28 02:23:48 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:48 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7" returned: 0 in 0.590s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:48 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7 is being set with open permissions: ugo+rw
Apr 28 02:23:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:48 devstack sudo[88181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7
Apr 28 02:23:48 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:48 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054" returned: 0 in 0.601s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:48 devstack sudo[88186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054
Apr 28 02:23:48 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:49 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7" returned: 0 in 0.475s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:49 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-525ab8ff-d663-4b9c-a3d9-302b2ad8bff2 tempest-VolumesDeleteCascade-355588683 None] Create snapshot completed successfully
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-624baad1-3d58-44c1-b12f-108899238aa4-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-624baad1-3d58-44c1-b12f-108899238aa4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:49 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054" returned: 0 in 0.499s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Lock "cinder-quobyte-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054" released by "delete_volume" :: held 1.154s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Performing cascade delete. {{(pid=81489) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-46990a64-a8a0-487f-9dac-0e475bc07fc7-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-46990a64-a8a0-487f-9dac-0e475bc07fc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Created reservations ['472e4aff-5a87-470d-a55d-3d98ea95988f', 'fa351f7f-6537-4f9e-94fa-be4b246fbe5c', '7644ad51-d355-443b-8de3-f2058d91eb6a', '80d09f6f-db0a-4413-b544-b6c67cb7717f'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-quobyte-624baad1-3d58-44c1-b12f-108899238aa4" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-624baad1-3d58-44c1-b12f-108899238aa4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-quobyte-46990a64-a8a0-487f-9dac-0e475bc07fc7" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-46990a64-a8a0-487f-9dac-0e475bc07fc7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Deleting offline snapshot 46990a64-a8a0-487f-9dac-0e475bc07fc7 of volume 624baad1-3d58-44c1-b12f-108899238aa4 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] snapshot_file for this snap is: volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd95a8d6-bcdf-49e2-ace0-b1b38ea887e3]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:49 devstack sudo[88191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:49 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:49 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7
Apr 28 02:23:49 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:50 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.490s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:50 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:50 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Deleted volume successfully.
Apr 28 02:23:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6bba7081-1aec-4dbb-ac89-fbba8af8295a tempest-VolumesActionsTest-222740078 None] Lock "cinder-ac7c4c1c-a5f7-42ac-8cb4-541bcc6ed054-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:50 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7" returned: 0 in 0.559s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-624baad1-3d58-44c1-b12f-108899238aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:23:50 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e5597b-1499-40e5-8edc-b72d0b48cebb]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:50 devstack sudo[88199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8
Apr 28 02:23:50 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:51 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8" returned: 0 in 0.717s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-624baad1-3d58-44c1-b12f-108899238aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:23:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:51 devstack sudo[88204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7
Apr 28 02:23:51 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:51 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7" returned: 0 in 0.724s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:51 devstack sudo[88210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7
Apr 28 02:23:51 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:52 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.46990a64-a8a0-487f-9dac-0e475bc07fc7" returned: 0 in 0.462s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-46990a64-a8a0-487f-9dac-0e475bc07fc7" released by "_delete_snapshot" :: held 2.576s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-624baad1-3d58-44c1-b12f-108899238aa4" released by "delete_snapshot" :: held 2.603s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Created reservations ['79e1961c-f1cf-47b1-8540-af93727625e0', '8cb4d792-6f89-4671-9351-8918d2a2c618', 'fe3f2e19-84ed-4701-8e01-a1efe6bd7b5c', 'a6678aba-1af8-4b9b-9eaf-155cafabbf02'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:52 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Delete snapshot completed successfully.
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-46990a64-a8a0-487f-9dac-0e475bc07fc7-delete_snapshot" released by "delete_snapshot" :: held 2.856s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-aa0a3ccf-e03b-4cff-b69f-f593868c14e8-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-aa0a3ccf-e03b-4cff-b69f-f593868c14e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-quobyte-624baad1-3d58-44c1-b12f-108899238aa4" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-624baad1-3d58-44c1-b12f-108899238aa4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-quobyte-aa0a3ccf-e03b-4cff-b69f-f593868c14e8" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-aa0a3ccf-e03b-4cff-b69f-f593868c14e8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Deleting offline snapshot aa0a3ccf-e03b-4cff-b69f-f593868c14e8 of volume 624baad1-3d58-44c1-b12f-108899238aa4 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] snapshot_file for this snap is: volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe885777-7cb4-42ef-96f2-7a9a35fcd7d6]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:52 devstack sudo[88214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8
Apr 28 02:23:52 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:52 devstack sudo[88215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:52 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:53 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.507s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:53 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8" returned: 0 in 0.748s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-624baad1-3d58-44c1-b12f-108899238aa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:23:53 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c996cd-4851-4f77-b697-fbb99e0c8833]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:53 devstack sudo[88223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4
Apr 28 02:23:53 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:53 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4" returned: 0 in 0.572s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:53 devstack sudo[88228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8
Apr 28 02:23:53 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:54 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8" returned: 0 in 0.804s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:54 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8
Apr 28 02:23:54 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:55 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4.aa0a3ccf-e03b-4cff-b69f-f593868c14e8" returned: 0 in 0.567s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:55 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-aa0a3ccf-e03b-4cff-b69f-f593868c14e8" released by "_delete_snapshot" :: held 2.854s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:55 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-624baad1-3d58-44c1-b12f-108899238aa4" released by "delete_snapshot" :: held 2.879s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:55 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Created reservations ['2233b49e-50f4-4d13-abfd-3a617f009994', 'dff0b79c-9b15-49ac-993c-ca0b3aa40392', '36d787b3-7e8f-4578-a680-3026baddfba1', '926e4f3b-7e72-4e33-938f-26567c7589c2'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:55 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Delete snapshot completed successfully.
Apr 28 02:23:55 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-aa0a3ccf-e03b-4cff-b69f-f593868c14e8-delete_snapshot" released by "delete_snapshot" :: held 3.039s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Snapshots deleted, issuing volume delete {{(pid=81489) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 28 02:23:55 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-quobyte-624baad1-3d58-44c1-b12f-108899238aa4" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:23:55 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-624baad1-3d58-44c1-b12f-108899238aa4" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:23:55 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efecc69-5d62-4da3-8cff-286710b97151]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:23:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:55 devstack sudo[88238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4
Apr 28 02:23:55 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:56 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4" returned: 0 in 0.717s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:56 devstack sudo[88244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4
Apr 28 02:23:56 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:56 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-624baad1-3d58-44c1-b12f-108899238aa4" returned: 0 in 0.548s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-624baad1-3d58-44c1-b12f-108899238aa4" released by "delete_volume" :: held 1.357s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:56 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Created reservations ['c508c1dc-4ebb-4840-b04a-7089a58bd666', 'f86244d8-e16b-4828-91b0-164b3204b4d7', '7ec59173-3386-42dd-96bf-a7257ddd5dea', 'ec6e06ab-a021-4bcc-97ba-43804b3e88d1'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:57 devstack sudo[88247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:23:57 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:23:57 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Flow 'volume_create_manager' (fd2f4b9d-46cd-4cd0-b03d-eb22fd37067e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28ef53a-948b-477d-b31e-4a72378bf297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.689s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:23:57 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Deleted volume successfully.
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28ef53a-948b-477d-b31e-4a72378bf297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1636706600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805e5e8e-624d-4e79-8afc-0758f8dae1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7e4071bc8f464b93ed949b9262e732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:58Z,use_quota=True,user_id='b90f9873a926489b8ae8f00a5b24ddfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b951b46d-09ad-4615-bd16-4269cbf3bc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b951b46d-09ad-4615-bd16-4269cbf3bc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88d8c41-d688-459e-b709-45bc1cf62b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88d8c41-d688-459e-b709-45bc1cf62b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805e5e8e-624d-4e79-8afc-0758f8dae1aa', 'volume_name': 'volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36656c1-927c-4485-af4b-212df479294d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36656c1-927c-4485-af4b-212df479294d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be28393-05e0-4701-8af4-9dfea97bd5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:57 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Volume 805e5e8e-624d-4e79-8afc-0758f8dae1aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa', 'volume_size': 1}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1636706600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805e5e8e-624d-4e79-8afc-0758f8dae1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7e4071bc8f464b93ed949b9262e732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:23:58Z,use_quota=True,user_id='b90f9873a926489b8ae8f00a5b24ddfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Creating volume 805e5e8e-624d-4e79-8afc-0758f8dae1aa {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:23:57 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2b31f787-4fc3-418d-a722-6ced7c28b617 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-624baad1-3d58-44c1-b12f-108899238aa4-delete_volume" released by "delete_volume" :: held 8.357s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:23:57 devstack sudo[88251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa 1073741824
Apr 28 02:23:57 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:58 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa 1073741824" returned: 0 in 0.670s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:23:58 devstack sudo[88257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa
Apr 28 02:23:58 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:23:58 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root
Apr 28 02:23:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa" returned: 0 in 0.467s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:23:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:23:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:23:58 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be28393-05e0-4701-8af4-9dfea97bd5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:58 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43401dc7-082a-4482-9903-ab07e89586eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:23:58 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Volume volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa (805e5e8e-624d-4e79-8afc-0758f8dae1aa): created successfully
Apr 28 02:23:58 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43401dc7-082a-4482-9903-ab07e89586eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:23:59 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Flow 'volume_create_manager' (fd2f4b9d-46cd-4cd0-b03d-eb22fd37067e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:23:59 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-28ee920c-8bef-433d-9969-b6cc4118a1b9 tempest-VolumesDeleteCascade-355588683 None] Created volume successfully.
Apr 28 02:23:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:23:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:23:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] Creating offline snapshot 6acb126b-09ea-4f2c-b286-17afc1f2708a of volume 805e5e8e-624d-4e79-8afc-0758f8dae1aa {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:24:00 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d9ac36-2035-487f-b69b-d4abdaa3244f]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:00 devstack sudo[88260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa
Apr 28 02:24:00 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:00 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa" returned: 0 in 0.633s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:00 devstack sudo[88265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a 1G
Apr 28 02:24:00 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:01 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a 1G" returned: 0 in 0.659s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:01 devstack sudo[88270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a
Apr 28 02:24:01 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:01 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a" returned: 0 in 0.577s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:01 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a is being set with open permissions: ugo+rw
Apr 28 02:24:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:01 devstack sudo[88275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a
Apr 28 02:24:01 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:02 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a" returned: 0 in 0.518s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:02 devstack sudo[88278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.info
Apr 28 02:24:02 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:02 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.info" returned: 0 in 0.452s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:02 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.info is being set with open permissions: ugo+rw
Apr 28 02:24:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:02 devstack sudo[88281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.info
Apr 28 02:24:02 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:03 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.info" returned: 0 in 0.482s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.432s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:03 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-1286e293-0f87-49ac-8041-19a4dc79436d tempest-VolumesDeleteCascade-355588683 None] Create snapshot completed successfully
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Flow 'volume_create_manager' (d418bafc-092e-410d-9f0d-3d2f1ef6a939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4b8e72-df1d-4345-a474-478f12cd5181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b4b8e72-df1d-4345-a474-478f12cd5181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1827005261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc52349-e690-41ef-a5b5-cdc33347d101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7e4071bc8f464b93ed949b9262e732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6acb126b-09ea-4f2c-b286-17afc1f2708a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:04Z,use_quota=True,user_id='b90f9873a926489b8ae8f00a5b24ddfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0c7fea-03ca-46a2-b3ba-3229a92e5882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0c7fea-03ca-46a2-b3ba-3229a92e5882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db5ddde-d255-4703-81ee-a4889596dd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db5ddde-d255-4703-81ee-a4889596dd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'abc52349-e690-41ef-a5b5-cdc33347d101', 'volume_name': 'volume-abc52349-e690-41ef-a5b5-cdc33347d101', 'volume_size': 1, 'snapshot_id': '6acb126b-09ea-4f2c-b286-17afc1f2708a'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34b1157-f993-44d2-b361-210f4bce35f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34b1157-f993-44d2-b361-210f4bce35f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc14a18-7e71-4d97-bbfa-6231e3f6726b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:04 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Volume abc52349-e690-41ef-a5b5-cdc33347d101: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-abc52349-e690-41ef-a5b5-cdc33347d101', 'volume_size': 1, 'snapshot_id': '6acb126b-09ea-4f2c-b286-17afc1f2708a'}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-quobyte-6acb126b-09ea-4f2c-b286-17afc1f2708a-abc52349-e690-41ef-a5b5-cdc33347d101" by "_create_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-6acb126b-09ea-4f2c-b286-17afc1f2708a-abc52349-e690-41ef-a5b5-cdc33347d101" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Creating volume abc52349-e690-41ef-a5b5-cdc33347d101 from snapshot 6acb126b-09ea-4f2c-b286-17afc1f2708a {{(pid=81489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-quobyte-abc52349-e690-41ef-a5b5-cdc33347d101" by "_copy_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-abc52349-e690-41ef-a5b5-cdc33347d101" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] snapshot: 6acb126b-09ea-4f2c-b286-17afc1f2708a, volume: abc52349-e690-41ef-a5b5-cdc33347d101,  {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[755ccdf9-e398-480f-a0a9-eb12dafbe8fa]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:04 devstack sudo[88284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a
Apr 28 02:24:04 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:05 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a" returned: 0 in 0.554s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:24:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 02:24:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Creating direct copy from snapshot {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 02:24:05 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e06589-271b-40c3-ab73-c4fde84f5cf8]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:05 devstack sudo[88289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa
Apr 28 02:24:05 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:05 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa" returned: 0 in 0.594s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:05 devstack cinder-volume[81489]: DEBUG cinder.utils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Path /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101 not found in is_blk_device check {{(pid=81489) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 02:24:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:05 devstack sudo[88294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101
Apr 28 02:24:05 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:08 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:24:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Flow 'volume_create_manager' (0d113090-04a2-4b18-ab6d-2bd6df1cc60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d19cb78-4f9c-46ed-8067-4a4babeefe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d19cb78-4f9c-46ed-8067-4a4babeefe67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1091159754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b07cc75-5361-4104-bab3-813fa78ae027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69460b41006d4b198c8d1d1ab66f984e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:08Z,use_quota=True,user_id='6655b29a56b54cc9a6de2bc32479c2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d35971d-393b-4647-aece-e887718e11b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d35971d-393b-4647-aece-e887718e11b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593eceef-1da8-4ea9-ba82-bd6788ce6069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593eceef-1da8-4ea9-ba82-bd6788ce6069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b07cc75-5361-4104-bab3-813fa78ae027', 'volume_name': 'volume-5b07cc75-5361-4104-bab3-813fa78ae027', 'volume_size': 2}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2decd7e3-a366-4e78-a127-e7df02b48a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2decd7e3-a366-4e78-a127-e7df02b48a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3ea317-9d7b-4f70-9d60-9e1a505a0f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:08 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Volume 5b07cc75-5361-4104-bab3-813fa78ae027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b07cc75-5361-4104-bab3-813fa78ae027', 'volume_size': 2}
Apr 28 02:24:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:10 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101" returned: 0 in 4.860s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:10 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ea5b4e-a704-47cf-a88f-dd0002e6060c]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:10 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa
Apr 28 02:24:10 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:11 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa" returned: 0 in 0.664s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101 {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:24:11 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Converted 1024.00 MB image at 210.63 MB/s
Apr 28 02:24:11 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101 is being set with open permissions: ugo+rw
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:11 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101
Apr 28 02:24:11 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:11 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101" returned: 0 in 0.430s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-abc52349-e690-41ef-a5b5-cdc33347d101" released by "_copy_volume_from_snapshot" :: held 7.202s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-6acb126b-09ea-4f2c-b286-17afc1f2708a-abc52349-e690-41ef-a5b5-cdc33347d101" released by "_create_volume_from_snapshot" :: held 7.233s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.249s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.631s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1091159754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b07cc75-5361-4104-bab3-813fa78ae027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69460b41006d4b198c8d1d1ab66f984e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:08Z,use_quota=True,user_id='6655b29a56b54cc9a6de2bc32479c2af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Creating volume 5b07cc75-5361-4104-bab3-813fa78ae027 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:24:11 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5b07cc75-5361-4104-bab3-813fa78ae027 2147483648 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:INSERT=39,cinder:UPDATE=164,cinder:SELECT=118,cinder:DELETE=16 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:24:11 devstack sudo[88315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5b07cc75-5361-4104-bab3-813fa78ae027 2147483648
Apr 28 02:24:11 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=126,cinder:INSERT=40,cinder:UPDATE=166,cinder:DELETE=14 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc14a18-7e71-4d97-bbfa-6231e3f6726b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abc52349-e690-41ef-a5b5-cdc33347d101', 'volume_size': 1, 'snapshot_id': '6acb126b-09ea-4f2c-b286-17afc1f2708a'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee73976b-3d20-4bbd-a30d-572b64199956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:11 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Volume volume-abc52349-e690-41ef-a5b5-cdc33347d101 (abc52349-e690-41ef-a5b5-cdc33347d101): created successfully
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee73976b-3d20-4bbd-a30d-572b64199956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Flow 'volume_create_manager' (d418bafc-092e-410d-9f0d-3d2f1ef6a939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:11 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-0a1bbffd-93fb-4c06-a1c3-086b2a350b17 tempest-VolumesDeleteCascade-355588683 None] Created volume successfully.
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-805e5e8e-624d-4e79-8afc-0758f8dae1aa-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-805e5e8e-624d-4e79-8afc-0758f8dae1aa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Performing cascade delete. {{(pid=81489) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-6acb126b-09ea-4f2c-b286-17afc1f2708a-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-6acb126b-09ea-4f2c-b286-17afc1f2708a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-quobyte-805e5e8e-624d-4e79-8afc-0758f8dae1aa" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-805e5e8e-624d-4e79-8afc-0758f8dae1aa" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-quobyte-6acb126b-09ea-4f2c-b286-17afc1f2708a" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-6acb126b-09ea-4f2c-b286-17afc1f2708a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Deleting offline snapshot 6acb126b-09ea-4f2c-b286-17afc1f2708a of volume 805e5e8e-624d-4e79-8afc-0758f8dae1aa {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] snapshot_file for this snap is: volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4708676-17a7-4f34-8b7e-a4e11936ff5e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:12 devstack sudo[88320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a
Apr 28 02:24:12 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:12 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5b07cc75-5361-4104-bab3-813fa78ae027 2147483648" returned: 0 in 0.713s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5b07cc75-5361-4104-bab3-813fa78ae027 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:12 devstack sudo[88322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5b07cc75-5361-4104-bab3-813fa78ae027
Apr 28 02:24:12 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:13 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a" returned: 0 in 0.530s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b78eb1-fc61-4fc0-82d8-b2d3114ac5df]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:13 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5b07cc75-5361-4104-bab3-813fa78ae027" returned: 0 in 0.441s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3ea317-9d7b-4f70-9d60-9e1a505a0f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b07cc75-5361-4104-bab3-813fa78ae027', 'volume_size': 2}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd2eacc-050c-47aa-a719-eb0043580481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:13 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Volume volume-5b07cc75-5361-4104-bab3-813fa78ae027 (5b07cc75-5361-4104-bab3-813fa78ae027): created successfully
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd2eacc-050c-47aa-a719-eb0043580481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Flow 'volume_create_manager' (0d113090-04a2-4b18-ab6d-2bd6df1cc60f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:13 devstack sudo[88328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa
Apr 28 02:24:13 devstack sudo[88328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:13 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-60140674-da42-4e31-9972-afeff47c2311 tempest-VolumesCloneNegativeTest-945456303 None] Created volume successfully.
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Acquiring lock "cinder-5b07cc75-5361-4104-bab3-813fa78ae027-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Lock "cinder-5b07cc75-5361-4104-bab3-813fa78ae027-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:13 devstack sudo[88328]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa" returned: 0 in 0.598s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:13 devstack sudo[88333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a
Apr 28 02:24:13 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Acquiring lock "cinder-quobyte-5b07cc75-5361-4104-bab3-813fa78ae027" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Lock "cinder-quobyte-5b07cc75-5361-4104-bab3-813fa78ae027" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb84f429-671b-4194-bd3e-d91d99842a5f]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5b07cc75-5361-4104-bab3-813fa78ae027 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:13 devstack sudo[88335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5b07cc75-5361-4104-bab3-813fa78ae027
Apr 28 02:24:13 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:14 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a" returned: 0 in 0.565s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:14 devstack sudo[88343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a
Apr 28 02:24:14 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:14 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5b07cc75-5361-4104-bab3-813fa78ae027" returned: 0 in 0.532s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5b07cc75-5361-4104-bab3-813fa78ae027 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:14 devstack sudo[88345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5b07cc75-5361-4104-bab3-813fa78ae027
Apr 28 02:24:14 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:14 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa.6acb126b-09ea-4f2c-b286-17afc1f2708a" returned: 0 in 0.451s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-6acb126b-09ea-4f2c-b286-17afc1f2708a" released by "_delete_snapshot" :: held 2.244s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-805e5e8e-624d-4e79-8afc-0758f8dae1aa" released by "delete_snapshot" :: held 2.275s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:14 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5b07cc75-5361-4104-bab3-813fa78ae027" returned: 0 in 0.469s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Created reservations ['a49bcfcb-8c8a-498e-a16e-614e413373c2', 'd657eaff-ec65-4eb4-a27a-68dcf7e422ea', '56061563-db9a-4e33-9486-2e18a2cbe02b', '2bd80554-0af5-4456-a7c5-4d8da8c67732'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Lock "cinder-quobyte-5b07cc75-5361-4104-bab3-813fa78ae027" released by "delete_volume" :: held 1.045s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:14 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Delete snapshot completed successfully.
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Created reservations ['855b765c-efd5-4243-bdfc-ddc62cce24b2', '1578c89e-32e6-4164-bf16-ef6ec201b686', '451d91fe-5811-4562-9c8c-17003fe53c41', 'd5fba931-ee24-4b7c-a730-1475ffc7efee'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-6acb126b-09ea-4f2c-b286-17afc1f2708a-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Snapshots deleted, issuing volume delete {{(pid=81489) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-quobyte-805e5e8e-624d-4e79-8afc-0758f8dae1aa" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-805e5e8e-624d-4e79-8afc-0758f8dae1aa" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70bbf2b-dc08-4a3b-a02e-cc70d04330f0]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:14 devstack sudo[88349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa
Apr 28 02:24:14 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:14 devstack sudo[88350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:24:14 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:15 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.439s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:15 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:24:15 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Deleted volume successfully.
Apr 28 02:24:15 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa" returned: 0 in 0.519s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:15 devstack sudo[88357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa
Apr 28 02:24:15 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-78da1158-9d58-406c-a975-a9a77f028dba tempest-VolumesCloneNegativeTest-945456303 None] Lock "cinder-5b07cc75-5361-4104-bab3-813fa78ae027-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:15 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-805e5e8e-624d-4e79-8afc-0758f8dae1aa" returned: 0 in 0.476s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-805e5e8e-624d-4e79-8afc-0758f8dae1aa" released by "delete_volume" :: held 1.051s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:15 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Created reservations ['6bdf61b1-5ae6-476d-aa18-3cee18d7e160', 'db34de15-56c7-4efa-aae2-e99ed8d46488', 'a68c8467-ea61-468d-8b6a-6dbf9dbcd836', 'a3f1e347-5863-49c1-959c-6801e322a92c'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:16 devstack sudo[88360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:24:16 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:16 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.475s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:24:16 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Deleted volume successfully.
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8f2bd4a9-66ad-499a-832d-f4835a5f8144 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-805e5e8e-624d-4e79-8afc-0758f8dae1aa-delete_volume" released by "delete_volume" :: held 4.217s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-abc52349-e690-41ef-a5b5-cdc33347d101-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-abc52349-e690-41ef-a5b5-cdc33347d101-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "cinder-quobyte-abc52349-e690-41ef-a5b5-cdc33347d101" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-abc52349-e690-41ef-a5b5-cdc33347d101" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a621a6bf-0c17-4622-a849-098b5a63e893]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:16 devstack sudo[88363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101
Apr 28 02:24:16 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:17 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101" returned: 0 in 0.604s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:17 devstack sudo[88369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101
Apr 28 02:24:17 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:17 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-abc52349-e690-41ef-a5b5-cdc33347d101" returned: 0 in 0.513s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-quobyte-abc52349-e690-41ef-a5b5-cdc33347d101" released by "delete_volume" :: held 1.159s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Created reservations ['6dec8070-9498-408a-a9a2-eace18c78921', 'aaca81a1-f3c4-4279-87d3-e2d18eec991e', '474c76b6-f088-435a-b9a3-2c5987cffe8f', '8e28b7c1-f876-4604-ae97-c7f6162d746b'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:18 devstack sudo[88372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:24:18 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Flow 'volume_create_manager' (12052973-451f-45a7-aacb-08269bd39ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5a01c1-eb09-4a90-9a51-eed11534c7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5a01c1-eb09-4a90-9a51-eed11534c7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1052601692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf725f2f-6a5f-484c-b8d6-358dee0a61f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='700f3e56ba1e4c2c8928080fb19c5b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:18Z,use_quota=True,user_id='8090fe7b66ca4addad609e7743580720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cb730e-9b18-453c-94f6-d86c8f5f0d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72cb730e-9b18-453c-94f6-d86c8f5f0d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afddd997-0561-4725-b6b7-e512831bce4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afddd997-0561-4725-b6b7-e512831bce4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf725f2f-6a5f-484c-b8d6-358dee0a61f8', 'volume_name': 'volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b45a471-6c61-483e-a5d7-875ff78bca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b45a471-6c61-483e-a5d7-875ff78bca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3dae299-3009-493b-8d3c-b37a4ab0a8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:18 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Volume cf725f2f-6a5f-484c-b8d6-358dee0a61f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8', 'volume_size': 1}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1052601692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf725f2f-6a5f-484c-b8d6-358dee0a61f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='700f3e56ba1e4c2c8928080fb19c5b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:18Z,use_quota=True,user_id='8090fe7b66ca4addad609e7743580720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Creating volume cf725f2f-6a5f-484c-b8d6-358dee0a61f8 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:24:18 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:18 devstack sudo[88374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8 1073741824
Apr 28 02:24:18 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:18 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.494s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:24:18 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Deleted volume successfully.
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6bb8d67c-49f0-406f-b801-b42c895f7007 tempest-VolumesDeleteCascade-355588683 None] Lock "cinder-abc52349-e690-41ef-a5b5-cdc33347d101-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:18 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8 1073741824" returned: 0 in 0.606s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:19 devstack sudo[88380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8
Apr 28 02:24:19 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:19 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8" returned: 0 in 0.500s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:24:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3dae299-3009-493b-8d3c-b37a4ab0a8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98836385-c7b8-4328-9dc7-9105aaddcd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:19 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Volume volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8 (cf725f2f-6a5f-484c-b8d6-358dee0a61f8): created successfully
Apr 28 02:24:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98836385-c7b8-4328-9dc7-9105aaddcd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Flow 'volume_create_manager' (12052973-451f-45a7-aacb-08269bd39ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:19 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-5324b6d4-54e9-44e6-8034-b310c806cfe0 tempest-VolumesListTestJSON-216984456 None] Created volume successfully.
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Flow 'volume_create_manager' (95a928bb-47dc-4b10-b49f-9bd55861609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c109525-7257-4ed8-8b9d-9121271dd21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c109525-7257-4ed8-8b9d-9121271dd21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2112663617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce028b3a-5cf9-421c-b829-c7666fd7f222,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='700f3e56ba1e4c2c8928080fb19c5b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:21Z,use_quota=True,user_id='8090fe7b66ca4addad609e7743580720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc68ed8-77bb-4562-b17b-15a1a3c7fd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc68ed8-77bb-4562-b17b-15a1a3c7fd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091cddd8-d50a-455f-add6-8c7deb1b5c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091cddd8-d50a-455f-add6-8c7deb1b5c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce028b3a-5cf9-421c-b829-c7666fd7f222', 'volume_name': 'volume-ce028b3a-5cf9-421c-b829-c7666fd7f222', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d16f8f-cfda-49c7-a995-3dca0fd65899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d16f8f-cfda-49c7-a995-3dca0fd65899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352cd210-69d7-4843-84b4-951af6358819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:20 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Volume ce028b3a-5cf9-421c-b829-c7666fd7f222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce028b3a-5cf9-421c-b829-c7666fd7f222', 'volume_size': 1}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2112663617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce028b3a-5cf9-421c-b829-c7666fd7f222,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='700f3e56ba1e4c2c8928080fb19c5b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:21Z,use_quota=True,user_id='8090fe7b66ca4addad609e7743580720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Creating volume ce028b3a-5cf9-421c-b829-c7666fd7f222 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:24:20 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:24:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ce028b3a-5cf9-421c-b829-c7666fd7f222 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:20 devstack sudo[88383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ce028b3a-5cf9-421c-b829-c7666fd7f222 1073741824
Apr 28 02:24:20 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:21 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ce028b3a-5cf9-421c-b829-c7666fd7f222 1073741824" returned: 0 in 0.698s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ce028b3a-5cf9-421c-b829-c7666fd7f222 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:21 devstack sudo[88394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ce028b3a-5cf9-421c-b829-c7666fd7f222
Apr 28 02:24:21 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:21 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:24:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Flow 'volume_create_manager' (b837da9d-7227-4509-87c6-f52af6af3817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee61f9cd-c68f-4cdd-bff5-be6c76fdcad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee61f9cd-c68f-4cdd-bff5-be6c76fdcad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1845656018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ea0d0b-c054-492a-8933-9cc77244001d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d0a4a2042f41bf8441952de4328309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:22Z,use_quota=True,user_id='c8e5bfe9cb494f5b8a36d5ed15adb31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73a4530-154d-4445-ac62-a8b31e25b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73a4530-154d-4445-ac62-a8b31e25b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:21 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36129549-b577-4748-b4ca-eb1d359321a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:21 devstack cinder-volume[81489]: DEBUG cinder.image.glance [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Creating Keystone auth plugin from conf {{(pid=81489) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36129549-b577-4748-b4ca-eb1d359321a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9ea0d0b-c054-492a-8933-9cc77244001d', 'volume_name': 'volume-b9ea0d0b-c054-492a-8933-9cc77244001d', 'volume_size': 1, 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd359658886d548bfa4a779ff0e6805b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68696e90-4455-4dcc-8c91-372acb183045', 'created_at': datetime.datetime(2026, 4, 28, 0, 10, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 0, 10, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68696e90-4455-4dcc-8c91-372acb183045/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd3e8c97430>}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbc4ea6-8ca6-4688-a47b-7bb237642d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbc4ea6-8ca6-4688-a47b-7bb237642d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4486c281-5862-45e9-908c-455939cd3ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:22 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Volume b9ea0d0b-c054-492a-8933-9cc77244001d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9ea0d0b-c054-492a-8933-9cc77244001d', 'volume_size': 1, 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd359658886d548bfa4a779ff0e6805b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68696e90-4455-4dcc-8c91-372acb183045', 'created_at': datetime.datetime(2026, 4, 28, 0, 10, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 0, 10, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68696e90-4455-4dcc-8c91-372acb183045/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd3e8c97430>}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Trying to clone b9ea0d0b-c054-492a-8933-9cc77244001d from image 68696e90-4455-4dcc-8c91-372acb183045 at location (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]). {{(pid=81489) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 28 02:24:22 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ce028b3a-5cf9-421c-b829-c7666fd7f222" returned: 0 in 0.473s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352cd210-69d7-4843-84b4-951af6358819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce028b3a-5cf9-421c-b829-c7666fd7f222', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47b3d21-aa18-4e87-b5b5-3f42a36c725c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:22 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Volume volume-ce028b3a-5cf9-421c-b829-c7666fd7f222 (ce028b3a-5cf9-421c-b829-c7666fd7f222): created successfully
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47b3d21-aa18-4e87-b5b5-3f42a36c725c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Flow 'volume_create_manager' (95a928bb-47dc-4b10-b49f-9bd55861609a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:22 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3fe95da6-7b1f-4cc9-9958-0f222de3291c tempest-VolumesListTestJSON-216984456 None] Created volume successfully.
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81489) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 28 02:24:22 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Image download 20.69 MB at 20.69 MB/s
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2f6693-48aa-4efe-a55d-ca4c9fa66eb9]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:22 devstack sudo[88398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD
Apr 28 02:24:22 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:22 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD" returned: 0 in 0.477s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Temporary image 68696e90-4455-4dcc-8c91-372acb183045 is fetched for user c8e5bfe9cb494f5b8a36d5ed15adb31e. {{(pid=81489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6584054b-4c72-46b6-984e-38c4bd711f1a]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:23 devstack sudo[88403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD
Apr 28 02:24:23 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Flow 'volume_create_manager' (cdbd9a3a-a84c-4376-a4b0-bb74fb95a94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65bc060-99e5-4458-94de-2cd997569c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65bc060-99e5-4458-94de-2cd997569c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-169300321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='700f3e56ba1e4c2c8928080fb19c5b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:23Z,use_quota=True,user_id='8090fe7b66ca4addad609e7743580720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63302ab1-52a0-482c-b586-78b1faeaad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63302ab1-52a0-482c-b586-78b1faeaad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042a409e-6595-4119-931c-f22a4c9274d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042a409e-6595-4119-931c-f22a4c9274d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2', 'volume_name': 'volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b397d0-c3d9-4899-b70d-f0262606a8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b397d0-c3d9-4899-b70d-f0262606a8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5475cfb-1fce-478f-93ce-cac2255d72cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:23 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Volume 7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2', 'volume_size': 1}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-169300321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='700f3e56ba1e4c2c8928080fb19c5b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:23Z,use_quota=True,user_id='8090fe7b66ca4addad609e7743580720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Creating volume 7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:24:23 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:23 devstack sudo[88405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2 1073741824
Apr 28 02:24:23 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:23 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD" returned: 0 in 0.534s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:23 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2 1073741824" returned: 0 in 0.623s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:24 devstack sudo[88414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2
Apr 28 02:24:24 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:24 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2" returned: 0 in 0.430s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.989s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1845656018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ea0d0b-c054-492a-8933-9cc77244001d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d0a4a2042f41bf8441952de4328309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:22Z,use_quota=True,user_id='c8e5bfe9cb494f5b8a36d5ed15adb31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Creating volume b9ea0d0b-c054-492a-8933-9cc77244001d {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:24:24 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5475cfb-1fce-478f-93ce-cac2255d72cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e5b2ef-1b89-4690-b1ef-710b51d9886f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:24 devstack sudo[88417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d 1073741824
Apr 28 02:24:24 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:24 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Volume volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2 (7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2): created successfully
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e5b2ef-1b89-4690-b1ef-710b51d9886f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Flow 'volume_create_manager' (cdbd9a3a-a84c-4376-a4b0-bb74fb95a94c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:24 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-4224bd0b-2dc3-4c40-8daf-b2eea42b1178 tempest-VolumesListTestJSON-216984456 None] Created volume successfully.
Apr 28 02:24:25 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d 1073741824" returned: 0 in 0.641s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:25 devstack sudo[88422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d
Apr 28 02:24:25 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:25 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d" returned: 0 in 0.447s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:25 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:24:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:25 devstack cinder-volume[81489]: DEBUG cinder.volume.volume_utils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Attempting download of 68696e90-4455-4dcc-8c91-372acb183045 ((None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}])) to volume b9ea0d0b-c054-492a-8933-9cc77244001d. {{(pid=81489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 28 02:24:25 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b07174-dd20-47e9-ac73-8e12ab745203]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045__w6c0vo5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:25 devstack sudo[88425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045__w6c0vo5
Apr 28 02:24:25 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:26 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045__w6c0vo5" returned: 0 in 0.538s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045__w6c0vo5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:26 devstack sudo[88429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045__w6c0vo5
Apr 28 02:24:26 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:26 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045__w6c0vo5" returned: 1 in 0.486s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_68696e90-4455-4dcc-8c91-372acb183045__w6c0vo5' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:24:26 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[171a3062-cd50-42d8-8152-a777ef4ec79b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:26 devstack sudo[88433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD
Apr 28 02:24:26 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:27 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD" returned: 0 in 0.505s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:27 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] 68696e90-4455-4dcc-8c91-372acb183045 was qcow2, converting to raw {{(pid=81489) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 28 02:24:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:27 devstack sudo[88439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d
Apr 28 02:24:27 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Acquiring lock "cinder-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Lock "cinder-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Acquiring lock "cinder-quobyte-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Lock "cinder-quobyte-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:27 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38a6261-f831-4f32-ae60-974d8dff29aa]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:27 devstack sudo[88446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2
Apr 28 02:24:27 devstack sudo[88446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:28 devstack sudo[88446]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2" returned: 0 in 0.637s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:28 devstack sudo[88459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2
Apr 28 02:24:28 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:28 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d" returned: 0 in 1.295s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_68696e90-4455-4dcc-8c91-372acb183045_umx6h296devstack@QuobyteHD, size 112.00 MB, duration 1.30 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:24:28 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Converted 112.00 MB image at 86.36 MB/s
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:28 devstack sudo[88461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d 1G
Apr 28 02:24:28 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:28 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2" returned: 0 in 0.472s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Lock "cinder-quobyte-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2" released by "delete_volume" :: held 1.151s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Created reservations ['a814d8df-64de-4107-8fb8-cc8eedce3dcd', 'e168e6f1-e6f5-4ed0-8562-cef060c8ca0b', '9f867171-070f-46e7-b501-6b8d39e8635f', '80875d72-a1ca-41cf-90dc-83843457da80'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:28 devstack sudo[88466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:24:28 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:28 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d 1G" returned: 0 in 0.499s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:29 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ca1f92-8f5b-49fe-8419-6f0bb3b49bb5]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:29 devstack sudo[88469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d
Apr 28 02:24:29 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:29 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.442s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:29 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:24:29 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Deleted volume successfully.
Apr 28 02:24:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2e5ecd44-91ac-44a0-a1a3-6058038fd7a9 tempest-VolumesListTestJSON-216984456 None] Lock "cinder-7ac3ad3c-cd43-4950-90c9-8b7b393ffcb2-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:29 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d" returned: 0 in 0.508s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:29 devstack sudo[88474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d
Apr 28 02:24:29 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Acquiring lock "cinder-ce028b3a-5cf9-421c-b829-c7666fd7f222-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Lock "cinder-ce028b3a-5cf9-421c-b829-c7666fd7f222-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Acquiring lock "cinder-quobyte-ce028b3a-5cf9-421c-b829-c7666fd7f222" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Lock "cinder-quobyte-ce028b3a-5cf9-421c-b829-c7666fd7f222" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:29 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b53d60b-58ca-4f23-8a89-faa6f43bfe2c]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ce028b3a-5cf9-421c-b829-c7666fd7f222 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:29 devstack sudo[88476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ce028b3a-5cf9-421c-b829-c7666fd7f222
Apr 28 02:24:29 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:30 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d" returned: 1 in 0.546s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG cinder.volume.volume_utils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Downloaded image 68696e90-4455-4dcc-8c91-372acb183045 ((None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}])) to volume b9ea0d0b-c054-492a-8933-9cc77244001d successfully. {{(pid=81489) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Temporary image 68696e90-4455-4dcc-8c91-372acb183045 for user c8e5bfe9cb494f5b8a36d5ed15adb31e is deleted. {{(pid=81489) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG cinder.volume.volume_utils [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Marking volume b9ea0d0b-c054-492a-8933-9cc77244001d as bootable. {{(pid=81489) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Copying metadata from image 68696e90-4455-4dcc-8c91-372acb183045 to b9ea0d0b-c054-492a-8933-9cc77244001d. {{(pid=81489) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Creating volume glance metadata for volume b9ea0d0b-c054-492a-8933-9cc77244001d backed by image 68696e90-4455-4dcc-8c91-372acb183045 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81489) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4486c281-5862-45e9-908c-455939cd3ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ea0d0b-c054-492a-8933-9cc77244001d', 'volume_size': 1, 'image_id': '68696e90-4455-4dcc-8c91-372acb183045', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/68696e90-4455-4dcc-8c91-372acb183045', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd359658886d548bfa4a779ff0e6805b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '68696e90-4455-4dcc-8c91-372acb183045', 'created_at': datetime.datetime(2026, 4, 28, 0, 10, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 28, 0, 10, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/68696e90-4455-4dcc-8c91-372acb183045/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fd3e8c97430>}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2caa1a3-36d5-4d8a-9886-d1dd2bbfef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:30 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Volume volume-b9ea0d0b-c054-492a-8933-9cc77244001d (b9ea0d0b-c054-492a-8933-9cc77244001d): created successfully
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2caa1a3-36d5-4d8a-9886-d1dd2bbfef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Flow 'volume_create_manager' (b837da9d-7227-4509-87c6-f52af6af3817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:30 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-44daa081-cb92-4d04-a150-56537c6b0989 tempest-VolumesExtendTest-971908425 None] Created volume successfully.
Apr 28 02:24:30 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ce028b3a-5cf9-421c-b829-c7666fd7f222" returned: 0 in 0.522s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ce028b3a-5cf9-421c-b829-c7666fd7f222 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:30 devstack sudo[88484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ce028b3a-5cf9-421c-b829-c7666fd7f222
Apr 28 02:24:30 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:30 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ce028b3a-5cf9-421c-b829-c7666fd7f222" returned: 0 in 0.425s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Lock "cinder-quobyte-ce028b3a-5cf9-421c-b829-c7666fd7f222" released by "delete_volume" :: held 0.983s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Created reservations ['760ee8cb-3bc1-4553-b265-7f172d6cc3b5', '4c7c943e-001d-4ce0-a9be-4b10d8813c0c', '433ee7f3-82b1-4059-a83a-501be55a6a3a', '1bb4c0ec-66f8-4085-998a-335db7aea35b'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:30 devstack sudo[88487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:24:30 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-275a836a-4f5e-4790-b3d5-e44e7c0b46fd tempest-VolumesExtendTest-971908425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-275a836a-4f5e-4790-b3d5-e44e7c0b46fd tempest-VolumesExtendTest-971908425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:31 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.462s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:31 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:24:31 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace8be0c-2440-4743-aa4c-c353523f2b18]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-275a836a-4f5e-4790-b3d5-e44e7c0b46fd tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:31 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Deleted volume successfully.
Apr 28 02:24:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-0f22e91a-0130-4e70-8bea-eef74e201f3f tempest-VolumesListTestJSON-216984456 None] Lock "cinder-ce028b3a-5cf9-421c-b829-c7666fd7f222-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:31 devstack sudo[88490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d
Apr 28 02:24:31 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:31 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-275a836a-4f5e-4790-b3d5-e44e7c0b46fd tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d" returned: 0 in 0.499s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-275a836a-4f5e-4790-b3d5-e44e7c0b46fd tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:32 devstack sudo[88494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d
Apr 28 02:24:32 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Acquiring lock "cinder-cf725f2f-6a5f-484c-b8d6-358dee0a61f8-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Lock "cinder-cf725f2f-6a5f-484c-b8d6-358dee0a61f8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Acquiring lock "cinder-quobyte-cf725f2f-6a5f-484c-b8d6-358dee0a61f8" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Lock "cinder-quobyte-cf725f2f-6a5f-484c-b8d6-358dee0a61f8" acquired by "delete_volume" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:32 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5984b29-11fb-4688-921f-6f8574bf334e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:32 devstack sudo[88496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8
Apr 28 02:24:32 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:32 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-275a836a-4f5e-4790-b3d5-e44e7c0b46fd tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d" returned: 1 in 0.538s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-275a836a-4f5e-4790-b3d5-e44e7c0b46fd tempest-VolumesExtendTest-971908425 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:24:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-275a836a-4f5e-4790-b3d5-e44e7c0b46fd tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d 2G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-275a836a-4f5e-4790-b3d5-e44e7c0b46fd tempest-VolumesExtendTest-971908425 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d 2G" returned: 0 in 0.061s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-275a836a-4f5e-4790-b3d5-e44e7c0b46fd tempest-VolumesExtendTest-971908425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.140s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:32 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-275a836a-4f5e-4790-b3d5-e44e7c0b46fd tempest-VolumesExtendTest-971908425 None] Extend volume completed successfully.
Apr 28 02:24:32 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8" returned: 0 in 0.540s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:32 devstack sudo[88507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8
Apr 28 02:24:32 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:33 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-cf725f2f-6a5f-484c-b8d6-358dee0a61f8" returned: 0 in 0.428s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Lock "cinder-quobyte-cf725f2f-6a5f-484c-b8d6-358dee0a61f8" released by "delete_volume" :: held 1.008s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Created reservations ['07bde4a3-e832-4628-a47a-1636767bde71', 'c05f1f65-696e-4b5d-aa09-591114c0fd3f', '74213747-e62c-4f5e-99f8-a1b9b64ff64d', '4e8c6179-6ed7-42f5-8073-57fb86a4e9f4'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:33 devstack sudo[88510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:24:33 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Acquiring lock "cinder-b9ea0d0b-c054-492a-8933-9cc77244001d-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Lock "cinder-b9ea0d0b-c054-492a-8933-9cc77244001d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Acquiring lock "cinder-quobyte-b9ea0d0b-c054-492a-8933-9cc77244001d" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:33 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.546s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:24:33 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Deleted volume successfully.
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Lock "cinder-quobyte-b9ea0d0b-c054-492a-8933-9cc77244001d" acquired by "delete_volume" :: waited 0.028s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-2168e1b0-8125-409b-b561-eb072065afb8 tempest-VolumesListTestJSON-216984456 None] Lock "cinder-cf725f2f-6a5f-484c-b8d6-358dee0a61f8-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[52069ede-fbd5-4dd8-88c9-8cb47faa34b3]: (4, 'raw') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:33 devstack sudo[88513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d
Apr 28 02:24:33 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:34 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d" returned: 0 in 0.580s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:34 devstack sudo[88517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d
Apr 28 02:24:34 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:35 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d" returned: 1 in 0.540s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d' failed. Not Retrying. {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 28 02:24:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:35 devstack sudo[88523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d
Apr 28 02:24:35 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:35 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b9ea0d0b-c054-492a-8933-9cc77244001d" returned: 0 in 0.468s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Lock "cinder-quobyte-b9ea0d0b-c054-492a-8933-9cc77244001d" released by "delete_volume" :: held 1.665s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:35 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Created reservations ['a9376670-01a7-45a5-a21a-b8f88ffa58c5', '07923724-9b70-4b51-8cbd-c0d7ef1ce175', 'db4152fa-07f5-4c91-8aee-1bcf9828fd9a', 'e7e176b5-7b37-4c58-982d-f3b4151d4a27'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:24:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:35 devstack sudo[88526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:24:35 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Flow 'volume_create_manager' (ae03c7e8-6fc2-48c4-8f22-0756ebecfada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844ec56e-e5dc-4fa5-977c-897aea3a8c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844ec56e-e5dc-4fa5-977c-897aea3a8c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-416136371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd59fe68-88bf-49b4-a594-82c92b7156d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01439ee8e59437e94e3c95191428452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:36Z,use_quota=True,user_id='14cbd9482e244ebe99c9a5350d8077f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da0dcfdf-2979-464d-ac40-012c1d592d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da0dcfdf-2979-464d-ac40-012c1d592d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a87c9d-84a0-4b90-a84c-e76fecbc792c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a87c9d-84a0-4b90-a84c-e76fecbc792c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd59fe68-88bf-49b4-a594-82c92b7156d4', 'volume_name': 'volume-fd59fe68-88bf-49b4-a594-82c92b7156d4', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40210984-e995-4e5a-8257-4438f5166dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40210984-e995-4e5a-8257-4438f5166dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53956ecb-10d0-4883-bdfe-e4766d39ebf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:36 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Volume fd59fe68-88bf-49b4-a594-82c92b7156d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd59fe68-88bf-49b4-a594-82c92b7156d4', 'volume_size': 1}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-416136371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd59fe68-88bf-49b4-a594-82c92b7156d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01439ee8e59437e94e3c95191428452',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:36Z,use_quota=True,user_id='14cbd9482e244ebe99c9a5350d8077f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Creating volume fd59fe68-88bf-49b4-a594-82c92b7156d4 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:24:36 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:36 devstack sudo[88528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4 1073741824
Apr 28 02:24:36 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:36 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.550s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:24:36 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Deleted volume successfully.
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d4dfb010-1db7-4501-8b70-005952c9ea45 tempest-VolumesExtendTest-971908425 None] Lock "cinder-b9ea0d0b-c054-492a-8933-9cc77244001d-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Flow 'volume_create_manager' (0b45099d-5926-4906-8ba9-529296b1d003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa1e0cf-71a7-4110-82c8-545a00d2fa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa1e0cf-71a7-4110-82c8-545a00d2fa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-778921053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89e04d6-7799-4484-bc41-917729a04ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d0a4a2042f41bf8441952de4328309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:36Z,use_quota=True,user_id='c8e5bfe9cb494f5b8a36d5ed15adb31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899f3ad2-7cac-4b17-b330-16dd91ea5e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899f3ad2-7cac-4b17-b330-16dd91ea5e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f26794-c69f-4f72-8999-959712b74bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f26794-c69f-4f72-8999-959712b74bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89e04d6-7799-4484-bc41-917729a04ee0', 'volume_name': 'volume-e89e04d6-7799-4484-bc41-917729a04ee0', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41736c5b-90c8-4e73-9d73-29ad5f88491c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41736c5b-90c8-4e73-9d73-29ad5f88491c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c50d73-b823-4109-a53d-522885810666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:36 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Volume e89e04d6-7799-4484-bc41-917729a04ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89e04d6-7799-4484-bc41-917729a04ee0', 'volume_size': 1}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:36 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4 1073741824" returned: 0 in 0.640s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:36 devstack sudo[88534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4
Apr 28 02:24:36 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:37 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4" returned: 0 in 0.428s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-778921053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89e04d6-7799-4484-bc41-917729a04ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d0a4a2042f41bf8441952de4328309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:24:36Z,use_quota=True,user_id='c8e5bfe9cb494f5b8a36d5ed15adb31e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Creating volume e89e04d6-7799-4484-bc41-917729a04ee0 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:24:37 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53956ecb-10d0-4883-bdfe-e4766d39ebf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd59fe68-88bf-49b4-a594-82c92b7156d4', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:37 devstack sudo[88538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0 1073741824
Apr 28 02:24:37 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef7ae73-305f-44f3-8724-09f9aa9d9ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:37 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Volume volume-fd59fe68-88bf-49b4-a594-82c92b7156d4 (fd59fe68-88bf-49b4-a594-82c92b7156d4): created successfully
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef7ae73-305f-44f3-8724-09f9aa9d9ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Flow 'volume_create_manager' (ae03c7e8-6fc2-48c4-8f22-0756ebecfada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:37 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-25510295-fd56-4055-a411-ed4b380564ec tempest-VolumesSnapshotListTestJSON-1309310989 None] Created volume successfully.
Apr 28 02:24:37 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0 1073741824" returned: 0 in 0.600s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:37 devstack sudo[88543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0
Apr 28 02:24:37 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:38 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0" returned: 0 in 0.478s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.042s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05c50d73-b823-4109-a53d-522885810666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89e04d6-7799-4484-bc41-917729a04ee0', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5602d8cd-c1bd-4896-99bc-6ce170c7207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] Creating offline snapshot fd464931-32e5-4797-b559-978da39dae35 of volume fd59fe68-88bf-49b4-a594-82c92b7156d4 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:24:38 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Volume volume-e89e04d6-7799-4484-bc41-917729a04ee0 (e89e04d6-7799-4484-bc41-917729a04ee0): created successfully
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5602d8cd-c1bd-4896-99bc-6ce170c7207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Flow 'volume_create_manager' (0b45099d-5926-4906-8ba9-529296b1d003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14cc814-99cc-4cd4-8af5-2ac9e4dfb84f]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:38 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-97d8896d-977b-4036-9093-89b341964708 tempest-VolumesExtendTest-971908425 None] Created volume successfully.
Apr 28 02:24:38 devstack sudo[88546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4
Apr 28 02:24:38 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:38 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4" returned: 0 in 0.522s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:38 devstack sudo[88551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 1G
Apr 28 02:24:38 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:39 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 1G" returned: 0 in 0.610s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd59fe68-88bf-49b4-a594-82c92b7156d4 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:39 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd59fe68-88bf-49b4-a594-82c92b7156d4 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35
Apr 28 02:24:39 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:40 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd59fe68-88bf-49b4-a594-82c92b7156d4 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35" returned: 0 in 0.496s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:40 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 is being set with open permissions: ugo+rw
Apr 28 02:24:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:40 devstack sudo[88561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35
Apr 28 02:24:40 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:40 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35" returned: 0 in 0.432s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:40 devstack sudo[88564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.info
Apr 28 02:24:40 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:40 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.info" returned: 0 in 0.445s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:40 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.info is being set with open permissions: ugo+rw
Apr 28 02:24:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:40 devstack sudo[88567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.info
Apr 28 02:24:40 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:41 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.info" returned: 0 in 0.430s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.042s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.717s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] Creating offline snapshot 329a3751-eb1f-4f9e-b36e-015e64403cea of volume e89e04d6-7799-4484-bc41-917729a04ee0 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:24:41 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f3787519-5800-4232-980f-079513164b87 tempest-VolumesSnapshotListTestJSON-1309310989 None] Create snapshot completed successfully
Apr 28 02:24:41 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b7c4fa-6216-4a0e-b3ce-12b987b70d92]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:41 devstack sudo[88570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0
Apr 28 02:24:41 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:41 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0" returned: 0 in 0.531s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:41 devstack sudo[88575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea 1G
Apr 28 02:24:41 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:42 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea 1G" returned: 0 in 0.626s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89e04d6-7799-4484-bc41-917729a04ee0 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:42 devstack sudo[88580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89e04d6-7799-4484-bc41-917729a04ee0 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea
Apr 28 02:24:42 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:43 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89e04d6-7799-4484-bc41-917729a04ee0 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea" returned: 0 in 0.489s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:43 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea is being set with open permissions: ugo+rw
Apr 28 02:24:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:43 devstack sudo[88585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea
Apr 28 02:24:43 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:43 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea" returned: 0 in 0.427s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:43 devstack sudo[88588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.info
Apr 28 02:24:43 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:43 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.info" returned: 0 in 0.441s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:43 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.info is being set with open permissions: ugo+rw
Apr 28 02:24:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:43 devstack sudo[88591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.info
Apr 28 02:24:43 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:44 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.info" returned: 0 in 0.420s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.028s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.797s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] Creating offline snapshot ee71559d-1782-4388-aeff-9f5079af8f69 of volume fd59fe68-88bf-49b4-a594-82c92b7156d4 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:24:44 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43523d1-21d8-42d8-b69d-aa82a5035319]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:44 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a8863f6d-b7d8-43e4-94c7-a2437183878f tempest-VolumesExtendTest-971908425 None] Create snapshot completed successfully
Apr 28 02:24:44 devstack sudo[88594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35
Apr 28 02:24:44 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9cb6fede-37b7-44d5-92e5-7f95bb274b17 tempest-VolumesExtendTest-971908425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:45 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35" returned: 0 in 0.536s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd59fe68-88bf-49b4-a594-82c92b7156d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:24:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:45 devstack sudo[88599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 1G
Apr 28 02:24:45 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:45 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 1G" returned: 0 in 0.628s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:45 devstack sudo[88604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69
Apr 28 02:24:45 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:46 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69" returned: 0 in 0.473s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:46 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 is being set with open permissions: ugo+rw
Apr 28 02:24:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:46 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69
Apr 28 02:24:46 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:46 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69" returned: 0 in 0.431s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.166s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9cb6fede-37b7-44d5-92e5-7f95bb274b17 tempest-VolumesExtendTest-971908425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.658s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:46 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd47e360-9c36-42ec-8c05-6603e4bea290]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9cb6fede-37b7-44d5-92e5-7f95bb274b17 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:46 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-54ccc898-24f3-40db-a526-c6242d100afe tempest-VolumesSnapshotListTestJSON-1309310989 None] Create snapshot completed successfully
Apr 28 02:24:46 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0
Apr 28 02:24:46 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:47 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9cb6fede-37b7-44d5-92e5-7f95bb274b17 tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0" returned: 0 in 0.540s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9cb6fede-37b7-44d5-92e5-7f95bb274b17 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea 2G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9cb6fede-37b7-44d5-92e5-7f95bb274b17 tempest-VolumesExtendTest-971908425 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea 2G" returned: 0 in 0.117s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9cb6fede-37b7-44d5-92e5-7f95bb274b17 tempest-VolumesExtendTest-971908425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.688s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.383s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:47 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] Creating offline snapshot f4ada79d-e9ed-46c3-86a1-9f7a9e13399e of volume fd59fe68-88bf-49b4-a594-82c92b7156d4 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:24:47 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eaa81d-7bbe-4941-ae24-28c0d6493799]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:47 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-9cb6fede-37b7-44d5-92e5-7f95bb274b17 tempest-VolumesExtendTest-971908425 None] Extend volume completed successfully.
Apr 28 02:24:47 devstack sudo[88653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69
Apr 28 02:24:47 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:47 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69" returned: 0 in 0.518s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:47 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd59fe68-88bf-49b4-a594-82c92b7156d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:24:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:47 devstack sudo[88660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e 1G
Apr 28 02:24:47 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Acquiring lock "cinder-329a3751-eb1f-4f9e-b36e-015e64403cea-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Lock "cinder-329a3751-eb1f-4f9e-b36e-015e64403cea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Acquiring lock "cinder-quobyte-e89e04d6-7799-4484-bc41-917729a04ee0" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Lock "cinder-quobyte-e89e04d6-7799-4484-bc41-917729a04ee0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Acquiring lock "cinder-quobyte-329a3751-eb1f-4f9e-b36e-015e64403cea" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Lock "cinder-quobyte-329a3751-eb1f-4f9e-b36e-015e64403cea" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Deleting offline snapshot 329a3751-eb1f-4f9e-b36e-015e64403cea of volume e89e04d6-7799-4484-bc41-917729a04ee0 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] snapshot_file for this snap is: volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0869a150-40f0-4332-9308-5b8529137508]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:48 devstack sudo[88665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea
Apr 28 02:24:48 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:48 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e 1G" returned: 0 in 0.659s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:48 devstack sudo[88667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e
Apr 28 02:24:48 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:48 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea" returned: 0 in 0.515s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e89e04d6-7799-4484-bc41-917729a04ee0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b794135f-b1e8-4ba7-b374-cbc1bce4db49]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:48 devstack sudo[88675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0
Apr 28 02:24:48 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:49 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e" returned: 0 in 0.485s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:49 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e is being set with open permissions: ugo+rw
Apr 28 02:24:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:49 devstack sudo[88677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e
Apr 28 02:24:49 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:49 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0" returned: 0 in 0.511s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:49 devstack sudo[88683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea
Apr 28 02:24:49 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:49 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e" returned: 0 in 0.461s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.227s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:49 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-c69b5baf-be53-4574-b0b9-2ac2dc19d136 tempest-VolumesSnapshotListTestJSON-1309310989 None] Create snapshot completed successfully
Apr 28 02:24:50 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea" returned: 0 in 0.584s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:50 devstack sudo[88688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea
Apr 28 02:24:50 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:50 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0.329a3751-eb1f-4f9e-b36e-015e64403cea" returned: 0 in 0.469s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Lock "cinder-quobyte-329a3751-eb1f-4f9e-b36e-015e64403cea" released by "_delete_snapshot" :: held 2.194s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Lock "cinder-quobyte-e89e04d6-7799-4484-bc41-917729a04ee0" released by "delete_snapshot" :: held 2.222s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Created reservations ['18a63ee6-0631-41ee-8a2b-4ffb2403c6e8', '62e5142b-e39f-4291-bf14-eb801a331b8b', 'e2bafa8a-5f63-493c-ad06-3732a8a4e318', '7dc4722e-2edc-4de8-ae2c-f196f88d5142'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:24:50 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Delete snapshot completed successfully.
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-33179826-0f40-44b1-924e-a8a1923f97cc tempest-VolumesExtendTest-971908425 None] Lock "cinder-329a3751-eb1f-4f9e-b36e-015e64403cea-delete_snapshot" released by "delete_snapshot" :: held 2.372s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "cinder-f4ada79d-e9ed-46c3-86a1-9f7a9e13399e-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-f4ada79d-e9ed-46c3-86a1-9f7a9e13399e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "cinder-quobyte-fd59fe68-88bf-49b4-a594-82c92b7156d4" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-fd59fe68-88bf-49b4-a594-82c92b7156d4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "cinder-quobyte-f4ada79d-e9ed-46c3-86a1-9f7a9e13399e" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-f4ada79d-e9ed-46c3-86a1-9f7a9e13399e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Deleting offline snapshot f4ada79d-e9ed-46c3-86a1-9f7a9e13399e of volume fd59fe68-88bf-49b4-a594-82c92b7156d4 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] snapshot_file for this snap is: volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[96173f15-3bd7-4e8e-9ec0-f299f7759d7a]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:50 devstack sudo[88691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e
Apr 28 02:24:50 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:51 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e" returned: 0 in 0.509s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd59fe68-88bf-49b4-a594-82c92b7156d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:24:51 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb93203d-a715-4fc5-aa38-d641e0df6961]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:51 devstack sudo[88696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69
Apr 28 02:24:51 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Acquiring lock "cinder-e89e04d6-7799-4484-bc41-917729a04ee0-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Lock "cinder-e89e04d6-7799-4484-bc41-917729a04ee0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Acquiring lock "cinder-quobyte-e89e04d6-7799-4484-bc41-917729a04ee0" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Lock "cinder-quobyte-e89e04d6-7799-4484-bc41-917729a04ee0" acquired by "delete_volume" :: waited 0.024s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:51 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b958b992-5fd0-4b8e-bc91-804f6a58732e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:51 devstack sudo[88698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0
Apr 28 02:24:51 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:51 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69" returned: 0 in 0.537s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd59fe68-88bf-49b4-a594-82c92b7156d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:24:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:51 devstack sudo[88703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e
Apr 28 02:24:51 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:52 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0" returned: 0 in 0.529s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:52 devstack sudo[88708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0
Apr 28 02:24:52 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:52 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e" returned: 0 in 0.608s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:52 devstack sudo[88713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e
Apr 28 02:24:52 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:52 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e89e04d6-7799-4484-bc41-917729a04ee0" returned: 0 in 0.489s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:52 devstack sudo[88716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:24:52 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Lock "cinder-quobyte-e89e04d6-7799-4484-bc41-917729a04ee0" released by "delete_volume" :: held 1.083s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Created reservations ['49550da0-923a-49d8-ade7-c5c5b24b4c08', '796db017-6697-4ecd-bce9-7adff062f0cf', 'd8b7eb84-ac16-4eef-8b12-9b799cf0c8c6', 'a92d066c-ddab-487f-8952-70e1ef9d6b46'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:24:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:52 devstack sudo[88718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:24:52 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:53 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.f4ada79d-e9ed-46c3-86a1-9f7a9e13399e" returned: 0 in 0.490s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-f4ada79d-e9ed-46c3-86a1-9f7a9e13399e" released by "_delete_snapshot" :: held 2.233s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-fd59fe68-88bf-49b4-a594-82c92b7156d4" released by "delete_snapshot" :: held 2.257s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Created reservations ['473f3d2e-ed23-4b23-a77f-a11f989238c9', 'ca402ea5-bc9e-4636-819d-0014d0ea8761', 'acfc406c-c7d0-455b-8569-978a7d09c130', '90153f84-71b6-4938-95fe-8e117b9a9f5d'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:24:53 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Delete snapshot completed successfully.
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-820d7797-fb15-4f17-a816-cc81d9d615f2 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-f4ada79d-e9ed-46c3-86a1-9f7a9e13399e-delete_snapshot" released by "delete_snapshot" :: held 2.379s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:53 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.522s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:24:53 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.481s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:24:53 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Deleted volume successfully.
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5100e5ee-5543-4b93-946f-91ac78b846a0 tempest-VolumesExtendTest-971908425 None] Lock "cinder-e89e04d6-7799-4484-bc41-917729a04ee0-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "cinder-ee71559d-1782-4388-aeff-9f5079af8f69-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-ee71559d-1782-4388-aeff-9f5079af8f69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "cinder-quobyte-fd59fe68-88bf-49b4-a594-82c92b7156d4" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-fd59fe68-88bf-49b4-a594-82c92b7156d4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "cinder-quobyte-ee71559d-1782-4388-aeff-9f5079af8f69" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-ee71559d-1782-4388-aeff-9f5079af8f69" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Deleting offline snapshot ee71559d-1782-4388-aeff-9f5079af8f69 of volume fd59fe68-88bf-49b4-a594-82c92b7156d4 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:24:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] snapshot_file for this snap is: volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:24:54 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[826bf66c-3f85-4380-904d-08f827e0c153]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:54 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69
Apr 28 02:24:54 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:54 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69" returned: 0 in 0.614s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd59fe68-88bf-49b4-a594-82c92b7156d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:24:54 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[495f3243-b172-43bb-81ef-0bbbe1cecbc6]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:54 devstack sudo[88729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35
Apr 28 02:24:54 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:55 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35" returned: 0 in 0.575s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd59fe68-88bf-49b4-a594-82c92b7156d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:24:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:55 devstack sudo[88734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69
Apr 28 02:24:55 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:55 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69" returned: 0 in 0.618s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:55 devstack sudo[88739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69
Apr 28 02:24:55 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:56 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.ee71559d-1782-4388-aeff-9f5079af8f69" returned: 0 in 0.479s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-ee71559d-1782-4388-aeff-9f5079af8f69" released by "_delete_snapshot" :: held 2.389s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-fd59fe68-88bf-49b4-a594-82c92b7156d4" released by "delete_snapshot" :: held 2.413s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:56 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Created reservations ['37058242-79cd-487d-8ef2-daac0293e878', '67473465-663a-40ea-8584-5b066a105dd3', 'c8e9faf5-e79e-474b-b29e-125b5027a1df', 'c21ba6c4-5bd8-420e-8417-2ef6a2a3bc46'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:24:56 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Delete snapshot completed successfully.
Apr 28 02:24:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-53fd6c0e-be3f-41fc-8d4d-50df202bf651 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-ee71559d-1782-4388-aeff-9f5079af8f69-delete_snapshot" released by "delete_snapshot" :: held 2.546s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "cinder-fd464931-32e5-4797-b559-978da39dae35-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-fd464931-32e5-4797-b559-978da39dae35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "cinder-quobyte-fd59fe68-88bf-49b4-a594-82c92b7156d4" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-fd59fe68-88bf-49b4-a594-82c92b7156d4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "cinder-quobyte-fd464931-32e5-4797-b559-978da39dae35" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-fd464931-32e5-4797-b559-978da39dae35" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Deleting offline snapshot fd464931-32e5-4797-b559-978da39dae35 of volume fd59fe68-88bf-49b4-a594-82c92b7156d4 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] snapshot_file for this snap is: volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[80de7c32-2eee-47d7-9302-7eeb6ac8b212]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:57 devstack sudo[88743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35
Apr 28 02:24:57 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:57 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35" returned: 0 in 0.593s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd59fe68-88bf-49b4-a594-82c92b7156d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e809d9-09a4-431f-aea9-aac7880d1107]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:24:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:57 devstack sudo[88748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4
Apr 28 02:24:57 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:58 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4" returned: 0 in 0.523s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:58 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35
Apr 28 02:24:58 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:58 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35" returned: 0 in 0.608s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:24:58 devstack sudo[88758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35
Apr 28 02:24:58 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:24:59 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root
Apr 28 02:24:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4.fd464931-32e5-4797-b559-978da39dae35" returned: 0 in 0.453s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:24:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-fd464931-32e5-4797-b559-978da39dae35" released by "_delete_snapshot" :: held 2.316s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-fd59fe68-88bf-49b4-a594-82c92b7156d4" released by "delete_snapshot" :: held 2.346s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:24:59 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Created reservations ['6778a16a-fbd3-4748-9ca4-f0e832590212', 'fced6c84-4a75-4138-bc93-d723c24176f3', '6deeeed2-e49b-4572-b75a-db41d7cc0909', '265cf91b-923a-4ab8-a0f4-db5fe193548f'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:24:59 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Delete snapshot completed successfully.
Apr 28 02:24:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c1ee5d1-ccc4-42b2-9e6f-f100a7d25140 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-fd464931-32e5-4797-b559-978da39dae35-delete_snapshot" released by "delete_snapshot" :: held 2.490s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:00 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "cinder-fd59fe68-88bf-49b4-a594-82c92b7156d4-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:00 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-fd59fe68-88bf-49b4-a594-82c92b7156d4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:00 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "cinder-quobyte-fd59fe68-88bf-49b4-a594-82c92b7156d4" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:00 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-fd59fe68-88bf-49b4-a594-82c92b7156d4" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:00 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a2123c-5173-4ac4-b5ff-7050dc508245]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:00 devstack sudo[88761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4
Apr 28 02:25:00 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:01 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4" returned: 0 in 0.648s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:01 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4
Apr 28 02:25:01 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:01 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-fd59fe68-88bf-49b4-a594-82c92b7156d4" returned: 0 in 0.531s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:01 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-quobyte-fd59fe68-88bf-49b4-a594-82c92b7156d4" released by "delete_volume" :: held 1.245s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:01 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Created reservations ['efb31690-a3e8-4155-a4e1-a445bf7f30fa', 'fbe5f2cf-0161-49d7-97a4-1673647b3598', 'f148aa1b-e913-400f-90aa-0f3fa3247ae6', '55c53a6b-9ea4-49f5-bc96-fe8e14fa6582'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:25:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:01 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:01 devstack sudo[88769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:25:01 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:02 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.519s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:02 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:25:02 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Deleted volume successfully.
Apr 28 02:25:02 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-20bdcfd3-2748-4f74-ba27-4d3b35aa99a6 tempest-VolumesSnapshotListTestJSON-1309310989 None] Lock "cinder-fd59fe68-88bf-49b4-a594-82c92b7156d4-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Flow 'volume_create_manager' (eaca90fb-f641-47eb-996a-87a7deb4b116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df9062a-c483-4e5a-997c-b3fae273ae02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df9062a-c483-4e5a-997c-b3fae273ae02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-889378277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a594d59-0d0e-4b1d-8e68-9be6d340b155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885506f386c447a19ee9e54af93cc405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:25:03Z,use_quota=True,user_id='47fa02dbbf9b43a6b49c3d8be7f3e76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c635aba3-0217-4879-9c1f-9fea8fa16b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c635aba3-0217-4879-9c1f-9fea8fa16b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9383a94c-ebb3-4600-bdba-8e6203584da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9383a94c-ebb3-4600-bdba-8e6203584da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a594d59-0d0e-4b1d-8e68-9be6d340b155', 'volume_name': 'volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49278d05-07d1-45e1-b025-f437ed60fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49278d05-07d1-45e1-b025-f437ed60fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a8eb87-f4be-4705-9420-2d8a543ac335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:03 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Volume 7a594d59-0d0e-4b1d-8e68-9be6d340b155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155', 'volume_size': 1}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-889378277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a594d59-0d0e-4b1d-8e68-9be6d340b155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885506f386c447a19ee9e54af93cc405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:25:03Z,use_quota=True,user_id='47fa02dbbf9b43a6b49c3d8be7f3e76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Creating volume 7a594d59-0d0e-4b1d-8e68-9be6d340b155 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:25:03 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:25:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:03 devstack sudo[88772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155 1073741824
Apr 28 02:25:03 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:04 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155 1073741824" returned: 0 in 0.665s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:04 devstack sudo[88777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155
Apr 28 02:25:04 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:04 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155" returned: 0 in 0.512s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:25:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a8eb87-f4be-4705-9420-2d8a543ac335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd74fa90-5af3-4aa2-8cd1-ec1e99fed736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:04 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Volume volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155 (7a594d59-0d0e-4b1d-8e68-9be6d340b155): created successfully
Apr 28 02:25:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd74fa90-5af3-4aa2-8cd1-ec1e99fed736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Flow 'volume_create_manager' (eaca90fb-f641-47eb-996a-87a7deb4b116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:04 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ad789019-3522-44df-bb6d-8c9c856c525e tempest-VolumesSnapshotTestJSON-253046103 None] Created volume successfully.
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Flow 'volume_create_manager' (b8cfc212-0711-4e39-938b-1394ecb2b2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e323b71-47d8-48c4-8135-5d8031c2ba56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e323b71-47d8-48c4-8135-5d8031c2ba56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4391653f-47e9-4df8-9e1c-9aca853529c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5421b697b3b0467cb16ba6a41c02f97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:25:05Z,use_quota=True,user_id='fbf37e6016c544b3859bde8ebd166583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351fa068-03bb-46dc-92ef-765dcea9fd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351fa068-03bb-46dc-92ef-765dcea9fd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ecbd56-943b-44dd-8b16-98a726db9144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ecbd56-943b-44dd-8b16-98a726db9144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4391653f-47e9-4df8-9e1c-9aca853529c2', 'volume_name': 'volume-4391653f-47e9-4df8-9e1c-9aca853529c2', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0cbf32-32f1-4ff7-9210-03f4e5096d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0cbf32-32f1-4ff7-9210-03f4e5096d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febec2be-5162-4a32-a65a-a2dfc231170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:05 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Volume 4391653f-47e9-4df8-9e1c-9aca853529c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4391653f-47e9-4df8-9e1c-9aca853529c2', 'volume_size': 1}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4391653f-47e9-4df8-9e1c-9aca853529c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5421b697b3b0467cb16ba6a41c02f97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:25:05Z,use_quota=True,user_id='fbf37e6016c544b3859bde8ebd166583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Creating volume 4391653f-47e9-4df8-9e1c-9aca853529c2 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:25:05 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4391653f-47e9-4df8-9e1c-9aca853529c2 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:05 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4391653f-47e9-4df8-9e1c-9aca853529c2 1073741824
Apr 28 02:25:05 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:06 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4391653f-47e9-4df8-9e1c-9aca853529c2 1073741824" returned: 0 in 0.616s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4391653f-47e9-4df8-9e1c-9aca853529c2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:06 devstack sudo[88785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4391653f-47e9-4df8-9e1c-9aca853529c2
Apr 28 02:25:06 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:06 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4391653f-47e9-4df8-9e1c-9aca853529c2" returned: 0 in 0.438s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:06 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:25:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.655s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febec2be-5162-4a32-a65a-a2dfc231170f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4391653f-47e9-4df8-9e1c-9aca853529c2', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdae6b80-f89a-4802-b6ea-8348607230f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:06 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] Creating offline snapshot 74a327cc-6226-479c-8c39-689bfe33a9e9 of volume 7a594d59-0d0e-4b1d-8e68-9be6d340b155 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:25:06 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Volume volume-4391653f-47e9-4df8-9e1c-9aca853529c2 (4391653f-47e9-4df8-9e1c-9aca853529c2): created successfully
Apr 28 02:25:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdae6b80-f89a-4802-b6ea-8348607230f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Flow 'volume_create_manager' (b8cfc212-0711-4e39-938b-1394ecb2b2dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:06 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[95db1d70-3d25-43f2-a1fe-7982529a4b2c]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:06 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ab891b9a-0023-46fb-92aa-b4012e5cee5c tempest-CinderUnicodeTest-839894788 None] Created volume successfully.
Apr 28 02:25:06 devstack sudo[88788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155
Apr 28 02:25:06 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:07 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155" returned: 0 in 0.517s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:07 devstack sudo[88793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9 1G
Apr 28 02:25:07 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:07 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9 1G" returned: 0 in 0.604s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:07 devstack sudo[88799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9
Apr 28 02:25:07 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Flow 'volume_create_manager' (67252b11-7232-492c-b0a3-c7d3ce3b8d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a005ec5-f572-4fad-a522-ab90494b76bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a005ec5-f572-4fad-a522-ab90494b76bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:25:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-436168428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5421b697b3b0467cb16ba6a41c02f97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:25:08Z,use_quota=True,user_id='fbf37e6016c544b3859bde8ebd166583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727c87bd-94ed-4069-bc18-42145977f00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727c87bd-94ed-4069-bc18-42145977f00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ad2865-8933-4ce3-b2eb-a53fe2ffeb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ad2865-8933-4ce3-b2eb-a53fe2ffeb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c', 'volume_name': 'volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c650df76-36a1-48f2-a723-fe0e3e217e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c650df76-36a1-48f2-a723-fe0e3e217e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1390ff6e-2d43-4760-98ed-ff5cef989ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:07 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Volume e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c', 'volume_size': 1}
Apr 28 02:25:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:08 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9" returned: 0 in 0.495s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:08 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9 is being set with open permissions: ugo+rw
Apr 28 02:25:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:08 devstack sudo[88804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9
Apr 28 02:25:08 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:08 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9" returned: 0 in 0.442s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:08 devstack sudo[88807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.info
Apr 28 02:25:08 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:09 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.info" returned: 0 in 0.471s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:09 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.info is being set with open permissions: ugo+rw
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:09 devstack sudo[88810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.info
Apr 28 02:25:09 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:09 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.info" returned: 0 in 0.453s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.088s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.668s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:25:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-436168428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5421b697b3b0467cb16ba6a41c02f97c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:25:08Z,use_quota=True,user_id='fbf37e6016c544b3859bde8ebd166583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Creating volume e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:25:09 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:25:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:09 devstack sudo[88813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c 1073741824
Apr 28 02:25:09 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:09 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b60cec44-a9c4-4dae-81e5-26e0a8486c0f tempest-VolumesSnapshotTestJSON-253046103 None] Create snapshot completed successfully
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-74a327cc-6226-479c-8c39-689bfe33a9e9-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-74a327cc-6226-479c-8c39-689bfe33a9e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-7a594d59-0d0e-4b1d-8e68-9be6d340b155" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-7a594d59-0d0e-4b1d-8e68-9be6d340b155" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-74a327cc-6226-479c-8c39-689bfe33a9e9" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-74a327cc-6226-479c-8c39-689bfe33a9e9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Deleting offline snapshot 74a327cc-6226-479c-8c39-689bfe33a9e9 of volume 7a594d59-0d0e-4b1d-8e68-9be6d340b155 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] snapshot_file for this snap is: volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:25:10 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c 1073741824" returned: 0 in 0.674s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[864d6970-bbc6-40f8-b9ef-8e4c31807b38]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:10 devstack sudo[88819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c
Apr 28 02:25:10 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:10 devstack sudo[88818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9
Apr 28 02:25:10 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:10 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c" returned: 0 in 0.453s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1390ff6e-2d43-4760-98ed-ff5cef989ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d1b1f1-64f9-4d48-99e4-dc7762cb3cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:10 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:10 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Volume volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c (e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c): created successfully
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d1b1f1-64f9-4d48-99e4-dc7762cb3cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Flow 'volume_create_manager' (67252b11-7232-492c-b0a3-c7d3ce3b8d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9" returned: 0 in 0.534s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:25:10 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-4e1f7304-28f9-4879-a15c-4ff0833f77a2 tempest-CinderUnicodeTest-839894788 None] Created volume successfully.
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07b7910-de6d-480e-93f6-5600ab5e1b23]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:10 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155
Apr 28 02:25:10 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] Creating offline snapshot e19bcb51-2782-4290-8569-20a17e210f1b of volume e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:25:11 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[72291f7c-4864-4a52-bb83-847ac1eb5aa1]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:11 devstack sudo[88828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c
Apr 28 02:25:11 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:11 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155" returned: 0 in 0.551s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:11 devstack sudo[88833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9
Apr 28 02:25:11 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:11 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c" returned: 0 in 0.524s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:11 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b 1G
Apr 28 02:25:11 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:11 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9" returned: 0 in 0.538s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:11 devstack sudo[88843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9
Apr 28 02:25:11 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:12 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b 1G" returned: 0 in 0.602s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:12 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155.74a327cc-6226-479c-8c39-689bfe33a9e9" returned: 0 in 0.466s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:12 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:UPDATE=152,cinder:DELETE=13,cinder:SELECT=127,cinder:INSERT=36 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:25:12 devstack sudo[88849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b
Apr 28 02:25:12 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:UPDATE=137,cinder:SELECT=121,cinder:INSERT=46,cinder:DELETE=12 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:25:12 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-74a327cc-6226-479c-8c39-689bfe33a9e9" released by "_delete_snapshot" :: held 2.218s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-7a594d59-0d0e-4b1d-8e68-9be6d340b155" released by "delete_snapshot" :: held 2.244s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:12 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Created reservations ['ba4d4dc7-37a8-4c5a-b394-e50a906fe966', '346316e4-7418-4400-a9b0-5856940318d3', '3a26b9a0-de33-4229-ace3-7d33f955906b', '21a751e7-d90a-4246-ba56-e380d0284bf3'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:25:12 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Delete snapshot completed successfully.
Apr 28 02:25:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-43df096f-4d3b-4b08-80c6-c572377618e3 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-74a327cc-6226-479c-8c39-689bfe33a9e9-delete_snapshot" released by "delete_snapshot" :: held 2.398s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:12 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b" returned: 0 in 0.489s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:12 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b is being set with open permissions: ugo+rw
Apr 28 02:25:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:12 devstack sudo[88854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b
Apr 28 02:25:12 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:13 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b" returned: 0 in 0.452s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:13 devstack sudo[88857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.info
Apr 28 02:25:13 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Flow 'volume_create_manager' (275258b3-aeb5-42c4-834d-6c4afca531e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5d76b9-8319-4584-b6f2-e395858392a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5d76b9-8319-4584-b6f2-e395858392a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1875527514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c281de-9d16-4aa7-a2af-5f759f17d8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885506f386c447a19ee9e54af93cc405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:25:14Z,use_quota=True,user_id='47fa02dbbf9b43a6b49c3d8be7f3e76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58f1d48-9cb4-4354-98b7-026df43dfdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58f1d48-9cb4-4354-98b7-026df43dfdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e427223c-bb83-4e49-b362-0ace26e1ba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e427223c-bb83-4e49-b362-0ace26e1ba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c281de-9d16-4aa7-a2af-5f759f17d8fd', 'volume_name': 'volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d071e56-8dfa-4af1-829b-c39e340e90ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d071e56-8dfa-4af1-829b-c39e340e90ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24799d81-22db-4d0c-b318-3a700bacb048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:13 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Volume e4c281de-9d16-4aa7-a2af-5f759f17d8fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd', 'volume_size': 1}
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:13 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.info" returned: 0 in 0.483s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:13 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.info is being set with open permissions: ugo+rw
Apr 28 02:25:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:13 devstack sudo[88860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.info
Apr 28 02:25:13 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:14 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.info" returned: 0 in 0.446s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.083s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1875527514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c281de-9d16-4aa7-a2af-5f759f17d8fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885506f386c447a19ee9e54af93cc405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:25:14Z,use_quota=True,user_id='47fa02dbbf9b43a6b49c3d8be7f3e76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Creating volume e4c281de-9d16-4aa7-a2af-5f759f17d8fd {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:25:14 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:14 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd 1073741824
Apr 28 02:25:14 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:14 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-80481fda-d50e-4034-9c45-050e7e066ab3 tempest-CinderUnicodeTest-839894788 None] Create snapshot completed successfully
Apr 28 02:25:14 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd 1073741824" returned: 0 in 0.616s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:15 devstack sudo[88868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd
Apr 28 02:25:15 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:15 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd" returned: 0 in 0.447s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24799d81-22db-4d0c-b318-3a700bacb048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4d5f9c-4f97-4abb-8670-bcd3efebd431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:15 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Volume volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd (e4c281de-9d16-4aa7-a2af-5f759f17d8fd): created successfully
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4d5f9c-4f97-4abb-8670-bcd3efebd431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Flow 'volume_create_manager' (275258b3-aeb5-42c4-834d-6c4afca531e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Acquiring lock "cinder-e19bcb51-2782-4290-8569-20a17e210f1b-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:15 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-22b973bd-c32d-4a26-a0f3-426eee0ba598 tempest-VolumesSnapshotTestJSON-253046103 None] Created volume successfully.
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Lock "cinder-e19bcb51-2782-4290-8569-20a17e210f1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Acquiring lock "cinder-quobyte-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Lock "cinder-quobyte-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Acquiring lock "cinder-quobyte-e19bcb51-2782-4290-8569-20a17e210f1b" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Lock "cinder-quobyte-e19bcb51-2782-4290-8569-20a17e210f1b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Deleting offline snapshot e19bcb51-2782-4290-8569-20a17e210f1b of volume e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] snapshot_file for this snap is: volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2207031c-0232-40d5-bbcc-972eac61b7df]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:15 devstack sudo[88871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b
Apr 28 02:25:15 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] Creating offline snapshot 885fd0f8-1292-4b35-a106-28a8e1afa73a of volume e4c281de-9d16-4aa7-a2af-5f759f17d8fd {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:25:16 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[838dc476-ee03-46fe-a9ee-bb3ad5b1428d]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:16 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:16 devstack sudo[88876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd
Apr 28 02:25:16 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b" returned: 0 in 0.584s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:25:16 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[def4b968-e8e3-474f-8e0f-1893f2b1d3c2]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:16 devstack sudo[88878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c
Apr 28 02:25:16 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:16 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd" returned: 0 in 0.544s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:16 devstack sudo[88886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a 1G
Apr 28 02:25:16 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:16 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c" returned: 0 in 0.534s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:16 devstack sudo[88888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b
Apr 28 02:25:16 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:17 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a 1G" returned: 0 in 0.627s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:17 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b" returned: 0 in 0.557s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:17 devstack sudo[88897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a
Apr 28 02:25:17 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:17 devstack sudo[88899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b
Apr 28 02:25:17 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:17 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c.e19bcb51-2782-4290-8569-20a17e210f1b" returned: 0 in 0.432s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:17 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a" returned: 0 in 0.488s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:17 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a is being set with open permissions: ugo+rw
Apr 28 02:25:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:17 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Lock "cinder-quobyte-e19bcb51-2782-4290-8569-20a17e210f1b" released by "_delete_snapshot" :: held 2.219s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:17 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Lock "cinder-quobyte-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c" released by "delete_snapshot" :: held 2.243s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:17 devstack sudo[88905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a
Apr 28 02:25:17 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:17 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Created reservations ['6e2d2c53-28eb-4eda-ac96-1bf78a743842', 'c488a0e0-56c4-4b5e-a6c4-97f452ab5688', 'c1a4ad6f-b6c2-4516-acac-5917971518bf', '9b1c41c4-4f88-418b-9450-8dfa988e9c78'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:25:17 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Delete snapshot completed successfully.
Apr 28 02:25:17 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-72393d7d-e8cf-4923-85e5-a584b9a6229b tempest-CinderUnicodeTest-839894788 None] Lock "cinder-e19bcb51-2782-4290-8569-20a17e210f1b-delete_snapshot" released by "delete_snapshot" :: held 2.375s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:18 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a" returned: 0 in 0.465s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:18 devstack sudo[88908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.info
Apr 28 02:25:18 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Acquiring lock "cinder-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Lock "cinder-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:18 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.info" returned: 0 in 0.478s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:18 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.info is being set with open permissions: ugo+rw
Apr 28 02:25:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Acquiring lock "cinder-quobyte-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:18 devstack sudo[88911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.info
Apr 28 02:25:18 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Lock "cinder-quobyte-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:18 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1fad17-3995-4dbf-b397-a926a577416e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:18 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c
Apr 28 02:25:18 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:19 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.info" returned: 0 in 0.440s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.119s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:19 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a70934d1-2cfe-4edc-83f4-3a4cc8aaa7ef tempest-VolumesSnapshotTestJSON-253046103 None] Create snapshot completed successfully
Apr 28 02:25:19 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c" returned: 0 in 0.536s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:19 devstack sudo[88919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c
Apr 28 02:25:19 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:19 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c" returned: 0 in 0.436s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:19 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Lock "cinder-quobyte-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c" released by "delete_volume" :: held 1.028s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:19 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Created reservations ['cd8664cf-cd26-4cce-8d8c-9bf0196a0224', '1f8153e1-2ac9-47e9-9d1a-c510786b61d5', '2b387fed-4a6b-4c76-9e2a-28ce93411817', '2a5dbee0-1584-49ca-b92f-0b80d88913cb'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:25:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:19 devstack sudo[88922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:25:19 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:20 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.458s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:25:20 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Deleted volume successfully.
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-411fc644-0401-4f39-96e3-0397d2148c76 tempest-CinderUnicodeTest-839894788 None] Lock "cinder-e8b67a7f-e0c9-49d0-82b9-05d6d3f8342c-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Flow 'volume_create_manager' (84b1e446-9e7e-4bff-aca3-66e3a052c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12500d02-a5a7-46f7-966b-f86c932c18a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12500d02-a5a7-46f7-966b-f86c932c18a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1972543605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca74da0f-a62a-4c84-a736-72952d3563f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885506f386c447a19ee9e54af93cc405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:25:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=885fd0f8-1292-4b35-a106-28a8e1afa73a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:25:21Z,use_quota=True,user_id='47fa02dbbf9b43a6b49c3d8be7f3e76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddf7b60-3d9f-4e1f-9f67-eb27dc7f1426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bddf7b60-3d9f-4e1f-9f67-eb27dc7f1426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e62739-4eb5-4f1c-a3a4-24d9bd88ee58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e62739-4eb5-4f1c-a3a4-24d9bd88ee58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ca74da0f-a62a-4c84-a736-72952d3563f7', 'volume_name': 'volume-ca74da0f-a62a-4c84-a736-72952d3563f7', 'volume_size': 2, 'snapshot_id': '885fd0f8-1292-4b35-a106-28a8e1afa73a'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0677396-c6cb-4c08-9f16-7e89540dfa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0677396-c6cb-4c08-9f16-7e89540dfa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3839f4ad-1b03-475b-9df0-df5130e34ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:20 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Volume ca74da0f-a62a-4c84-a736-72952d3563f7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ca74da0f-a62a-4c84-a736-72952d3563f7', 'volume_size': 2, 'snapshot_id': '885fd0f8-1292-4b35-a106-28a8e1afa73a'}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-885fd0f8-1292-4b35-a106-28a8e1afa73a-ca74da0f-a62a-4c84-a736-72952d3563f7" by "_create_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-885fd0f8-1292-4b35-a106-28a8e1afa73a-ca74da0f-a62a-4c84-a736-72952d3563f7" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Creating volume ca74da0f-a62a-4c84-a736-72952d3563f7 from snapshot 885fd0f8-1292-4b35-a106-28a8e1afa73a {{(pid=81489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-ca74da0f-a62a-4c84-a736-72952d3563f7" by "_copy_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-ca74da0f-a62a-4c84-a736-72952d3563f7" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] snapshot: 885fd0f8-1292-4b35-a106-28a8e1afa73a, volume: ca74da0f-a62a-4c84-a736-72952d3563f7,  {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cff737a-2ad1-4c2e-a886-9b6f15749b1e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:20 devstack sudo[88925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a
Apr 28 02:25:20 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Acquiring lock "cinder-4391653f-47e9-4df8-9e1c-9aca853529c2-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Lock "cinder-4391653f-47e9-4df8-9e1c-9aca853529c2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Acquiring lock "cinder-quobyte-4391653f-47e9-4df8-9e1c-9aca853529c2" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Lock "cinder-quobyte-4391653f-47e9-4df8-9e1c-9aca853529c2" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccd4ce0-0f7a-47f9-b112-f149efd847e4]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4391653f-47e9-4df8-9e1c-9aca853529c2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:21 devstack sudo[88927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4391653f-47e9-4df8-9e1c-9aca853529c2
Apr 28 02:25:21 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:21 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a" returned: 0 in 0.579s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Creating direct copy from snapshot {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca688c3a-0618-4c89-a9a0-3951cc0605ca]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:21 devstack sudo[88938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd
Apr 28 02:25:21 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:21 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4391653f-47e9-4df8-9e1c-9aca853529c2" returned: 0 in 0.509s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4391653f-47e9-4df8-9e1c-9aca853529c2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:21 devstack sudo[88943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4391653f-47e9-4df8-9e1c-9aca853529c2
Apr 28 02:25:21 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:21 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd" returned: 0 in 0.534s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG cinder.utils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Path /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7 not found in is_blk_device check {{(pid=81489) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:21 devstack sudo[88949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7
Apr 28 02:25:21 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:21 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4391653f-47e9-4df8-9e1c-9aca853529c2" returned: 0 in 0.449s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Lock "cinder-quobyte-4391653f-47e9-4df8-9e1c-9aca853529c2" released by "delete_volume" :: held 0.995s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:21 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Created reservations ['410e992a-de24-4d58-bebc-5b3cefe60699', 'a85da40e-f18d-4467-b39b-ff7859bdf088', '108a7616-5336-42eb-87c9-86cfbd187669', 'e2d1cff6-2512-4b62-ba4b-f7c0d5efd326'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:25:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:22 devstack sudo[88951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:25:22 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:22 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.472s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:22 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:25:22 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Deleted volume successfully.
Apr 28 02:25:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b606c18b-8c7d-4002-8f4e-62fd9090ffd9 tempest-CinderUnicodeTest-839894788 None] Lock "cinder-4391653f-47e9-4df8-9e1c-9aca853529c2-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:27 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7" returned: 0 in 5.263s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:27 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0879ce5-6c43-4109-94f3-68711787257b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:27 devstack sudo[88966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd
Apr 28 02:25:27 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:27 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd" returned: 0 in 0.655s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:27 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7 {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:25:27 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Converted 1024.00 MB image at 194.52 MB/s
Apr 28 02:25:27 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7 is being set with open permissions: ugo+rw
Apr 28 02:25:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:27 devstack sudo[89200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7
Apr 28 02:25:27 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:28 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7" returned: 0 in 0.430s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-ca74da0f-a62a-4c84-a736-72952d3563f7" released by "_copy_volume_from_snapshot" :: held 7.554s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-885fd0f8-1292-4b35-a106-28a8e1afa73a-ca74da0f-a62a-4c84-a736-72952d3563f7" released by "_create_volume_from_snapshot" :: held 7.583s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.598s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3839f4ad-1b03-475b-9df0-df5130e34ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca74da0f-a62a-4c84-a736-72952d3563f7', 'volume_size': 2, 'snapshot_id': '885fd0f8-1292-4b35-a106-28a8e1afa73a'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ca5e20-1ee6-4e02-90e4-7b9b11bb4ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:28 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Volume volume-ca74da0f-a62a-4c84-a736-72952d3563f7 (ca74da0f-a62a-4c84-a736-72952d3563f7): created successfully
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ca5e20-1ee6-4e02-90e4-7b9b11bb4ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Flow 'volume_create_manager' (84b1e446-9e7e-4bff-aca3-66e3a052c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:28 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ac6a1e3e-f0ba-4cfa-9f37-041363837ea4 tempest-VolumesSnapshotTestJSON-253046103 None] Created volume successfully.
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-ca74da0f-a62a-4c84-a736-72952d3563f7-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-ca74da0f-a62a-4c84-a736-72952d3563f7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-ca74da0f-a62a-4c84-a736-72952d3563f7" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-ca74da0f-a62a-4c84-a736-72952d3563f7" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cecef0-6528-420a-b264-11464e795ab3]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:28 devstack sudo[89203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7
Apr 28 02:25:28 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:29 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7" returned: 0 in 0.499s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:29 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7
Apr 28 02:25:29 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:29 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ca74da0f-a62a-4c84-a736-72952d3563f7" returned: 0 in 0.434s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-ca74da0f-a62a-4c84-a736-72952d3563f7" released by "delete_volume" :: held 0.976s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Created reservations ['d50b85e5-ab5d-40d5-b848-b171892d3811', '463fd089-0e12-48ff-8c85-9acc1dd9008b', '241c8f40-0fa5-4b6e-bf94-f2830f7f2a91', 'c1bbb671-cb56-4f7f-86ac-f90d8befbf1a'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:29 devstack sudo[89211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:25:29 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-885fd0f8-1292-4b35-a106-28a8e1afa73a-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-885fd0f8-1292-4b35-a106-28a8e1afa73a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-e4c281de-9d16-4aa7-a2af-5f759f17d8fd" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-e4c281de-9d16-4aa7-a2af-5f759f17d8fd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-885fd0f8-1292-4b35-a106-28a8e1afa73a" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-885fd0f8-1292-4b35-a106-28a8e1afa73a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Deleting offline snapshot 885fd0f8-1292-4b35-a106-28a8e1afa73a of volume e4c281de-9d16-4aa7-a2af-5f759f17d8fd {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] snapshot_file for this snap is: volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1983477a-8cdc-4998-babb-d78ac8e6d305]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:30 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a
Apr 28 02:25:30 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:30 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.471s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:30 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:25:30 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Deleted volume successfully.
Apr 28 02:25:30 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-bb224772-1639-4662-8ef1-4107b28e692c tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-ca74da0f-a62a-4c84-a736-72952d3563f7-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:30 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a" returned: 0 in 0.536s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:25:30 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b3936b-35ca-4ded-83a0-6c86548a73c3]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:30 devstack sudo[89219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd
Apr 28 02:25:30 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:31 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd" returned: 0 in 0.520s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:31 devstack sudo[89224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a
Apr 28 02:25:31 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:31 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a" returned: 0 in 0.528s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:31 devstack sudo[89229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a
Apr 28 02:25:31 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:32 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd.885fd0f8-1292-4b35-a106-28a8e1afa73a" returned: 0 in 0.434s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-885fd0f8-1292-4b35-a106-28a8e1afa73a" released by "_delete_snapshot" :: held 2.112s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-e4c281de-9d16-4aa7-a2af-5f759f17d8fd" released by "delete_snapshot" :: held 2.133s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:32 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Created reservations ['63e51458-7e08-4d7f-ab54-0154d18c7436', 'e72d4e6b-8d4a-44b3-a556-a1c0cffbeb56', 'c3445bec-2f7e-4c3a-938d-8a3aaf4fc6a4', '21065f8a-4883-44dc-9c1a-92dfcfcdf7af'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:25:32 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Delete snapshot completed successfully.
Apr 28 02:25:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3e484bd4-6887-457c-8a06-bd62a563bafe tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-885fd0f8-1292-4b35-a106-28a8e1afa73a-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-e4c281de-9d16-4aa7-a2af-5f759f17d8fd-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-e4c281de-9d16-4aa7-a2af-5f759f17d8fd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-e4c281de-9d16-4aa7-a2af-5f759f17d8fd" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-e4c281de-9d16-4aa7-a2af-5f759f17d8fd" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:33 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e77397a-47fe-432a-9f5d-4cdd0680b1ef]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:33 devstack sudo[89232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd
Apr 28 02:25:33 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:33 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd" returned: 0 in 0.495s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:33 devstack sudo[89237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd
Apr 28 02:25:33 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:34 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e4c281de-9d16-4aa7-a2af-5f759f17d8fd" returned: 0 in 0.424s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:34 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-e4c281de-9d16-4aa7-a2af-5f759f17d8fd" released by "delete_volume" :: held 0.976s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:34 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Created reservations ['e4e2b6c5-99f7-4f2e-a139-312d6ac3f692', '8d9848d9-dc47-44e3-9934-c68184fe5d15', 'c10c06de-ba33-4143-8c30-13f16e65e859', 'd9b60ff2-2739-47f5-987e-463550048bd5'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:25:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:34 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:34 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:34 devstack sudo[89240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:25:34 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:34 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.426s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:34 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:25:34 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Deleted volume successfully.
Apr 28 02:25:34 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-597e9f73-81b2-47b3-a25f-abe56814160b tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-e4c281de-9d16-4aa7-a2af-5f759f17d8fd-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Flow 'volume_create_manager' (e052f195-1197-495f-b087-994b2b9ba811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1dcc24-d573-4a94-af5a-543366aafa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1dcc24-d573-4a94-af5a-543366aafa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1754288921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597f7e1f-120a-464f-9b9e-80720e01d1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885506f386c447a19ee9e54af93cc405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:25:36Z,use_quota=True,user_id='47fa02dbbf9b43a6b49c3d8be7f3e76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0368a0-e5f1-45e5-90b3-68c1a17e4039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0368a0-e5f1-45e5-90b3-68c1a17e4039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ab6266-86b0-4a10-8cbf-75a3bf97e9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ab6266-86b0-4a10-8cbf-75a3bf97e9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '597f7e1f-120a-464f-9b9e-80720e01d1a6', 'volume_name': 'volume-597f7e1f-120a-464f-9b9e-80720e01d1a6', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e838fd6a-57ac-4f96-b62e-2729d06d6e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e838fd6a-57ac-4f96-b62e-2729d06d6e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09be9583-adfc-4a67-8383-7e47319d0d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:35 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Volume 597f7e1f-120a-464f-9b9e-80720e01d1a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-597f7e1f-120a-464f-9b9e-80720e01d1a6', 'volume_size': 1}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1754288921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597f7e1f-120a-464f-9b9e-80720e01d1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885506f386c447a19ee9e54af93cc405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:25:36Z,use_quota=True,user_id='47fa02dbbf9b43a6b49c3d8be7f3e76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Creating volume 597f7e1f-120a-464f-9b9e-80720e01d1a6 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:25:35 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:25:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:35 devstack sudo[89244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 1073741824
Apr 28 02:25:35 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:36 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 1073741824" returned: 0 in 0.602s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:36 devstack sudo[89249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6
Apr 28 02:25:36 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:36 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6" returned: 0 in 0.443s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:25:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09be9583-adfc-4a67-8383-7e47319d0d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-597f7e1f-120a-464f-9b9e-80720e01d1a6', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6754e7e5-7d33-4679-bbf2-35226ba79b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:36 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Volume volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 (597f7e1f-120a-464f-9b9e-80720e01d1a6): created successfully
Apr 28 02:25:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6754e7e5-7d33-4679-bbf2-35226ba79b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Flow 'volume_create_manager' (e052f195-1197-495f-b087-994b2b9ba811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:36 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-373bd7e0-7ec5-4c95-9898-4e4d202b7361 tempest-VolumesSnapshotTestJSON-253046103 None] Created volume successfully.
Apr 28 02:25:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] Creating offline snapshot 9dd064be-43dd-4c72-ad29-478785fc3542 of volume 597f7e1f-120a-464f-9b9e-80720e01d1a6 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:25:37 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec4df80-7ecb-47ee-bb4d-991825851056]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:38 devstack sudo[89253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6
Apr 28 02:25:38 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:38 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6" returned: 0 in 0.501s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:38 devstack sudo[89258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542 1G
Apr 28 02:25:38 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:39 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542 1G" returned: 0 in 0.570s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:39 devstack sudo[89263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542
Apr 28 02:25:39 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:39 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542" returned: 0 in 0.465s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:39 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542 is being set with open permissions: ugo+rw
Apr 28 02:25:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:39 devstack sudo[89268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542
Apr 28 02:25:39 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:39 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542" returned: 0 in 0.430s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:39 devstack sudo[89271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.info
Apr 28 02:25:39 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:40 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.info" returned: 0 in 0.437s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:40 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.info is being set with open permissions: ugo+rw
Apr 28 02:25:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:40 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.info
Apr 28 02:25:40 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:40 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.info" returned: 0 in 0.434s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:40 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-342d8bc7-d33a-48d0-aa08-cb976f86085d tempest-VolumesSnapshotTestJSON-253046103 None] Create snapshot completed successfully
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Flow 'volume_create_manager' (9d219744-7914-48ba-8b98-527f32c58c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2a71d7-c1a0-459b-b922-61bb9dbac9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2a71d7-c1a0-459b-b922-61bb9dbac9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-815069410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a022edfd-a430-44ba-9256-61b079ff961e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='885506f386c447a19ee9e54af93cc405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9dd064be-43dd-4c72-ad29-478785fc3542,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:25:41Z,use_quota=True,user_id='47fa02dbbf9b43a6b49c3d8be7f3e76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcb196b-b286-491e-8155-424984e250c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcb196b-b286-491e-8155-424984e250c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257b0071-b1be-4328-b1bb-a68dd3a1be61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257b0071-b1be-4328-b1bb-a68dd3a1be61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a022edfd-a430-44ba-9256-61b079ff961e', 'volume_name': 'volume-a022edfd-a430-44ba-9256-61b079ff961e', 'volume_size': 1, 'snapshot_id': '9dd064be-43dd-4c72-ad29-478785fc3542'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec89b9fb-466f-4159-9384-e24f957e6941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec89b9fb-466f-4159-9384-e24f957e6941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a18a3ad-ea91-4b62-ac8d-ae152083d21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:41 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Volume a022edfd-a430-44ba-9256-61b079ff961e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a022edfd-a430-44ba-9256-61b079ff961e', 'volume_size': 1, 'snapshot_id': '9dd064be-43dd-4c72-ad29-478785fc3542'}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-9dd064be-43dd-4c72-ad29-478785fc3542-a022edfd-a430-44ba-9256-61b079ff961e" by "_create_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-9dd064be-43dd-4c72-ad29-478785fc3542-a022edfd-a430-44ba-9256-61b079ff961e" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Creating volume a022edfd-a430-44ba-9256-61b079ff961e from snapshot 9dd064be-43dd-4c72-ad29-478785fc3542 {{(pid=81489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-a022edfd-a430-44ba-9256-61b079ff961e" by "_copy_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-a022edfd-a430-44ba-9256-61b079ff961e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] snapshot: 9dd064be-43dd-4c72-ad29-478785fc3542, volume: a022edfd-a430-44ba-9256-61b079ff961e,  {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c10a297-6808-41a1-ad9c-7fb9cd0b1ba2]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:41 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542
Apr 28 02:25:41 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:42 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542" returned: 0 in 0.506s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-597f7e1f-120a-464f-9b9e-80720e01d1a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:25:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 02:25:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Creating direct copy from snapshot {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 02:25:42 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7891c4da-d51d-42d9-93a6-ecdb1051fd7c]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:42 devstack sudo[89282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6
Apr 28 02:25:42 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:42 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6" returned: 0 in 0.528s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:42 devstack cinder-volume[81489]: DEBUG cinder.utils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Path /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e not found in is_blk_device check {{(pid=81489) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 02:25:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:42 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e
Apr 28 02:25:42 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:46 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e" returned: 0 in 4.319s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:46 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b452042-3c38-4dc7-bc14-b4899607100b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:47 devstack sudo[89299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6
Apr 28 02:25:47 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:47 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6" returned: 0 in 0.630s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:47 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6, size 1024.00 MB, duration 4.32 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:25:47 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Converted 1024.00 MB image at 237.02 MB/s
Apr 28 02:25:47 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e is being set with open permissions: ugo+rw
Apr 28 02:25:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:47 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e
Apr 28 02:25:47 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:48 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e" returned: 0 in 0.441s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-a022edfd-a430-44ba-9256-61b079ff961e" released by "_copy_volume_from_snapshot" :: held 6.511s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-9dd064be-43dd-4c72-ad29-478785fc3542-a022edfd-a430-44ba-9256-61b079ff961e" released by "_create_volume_from_snapshot" :: held 6.548s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.563s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a18a3ad-ea91-4b62-ac8d-ae152083d21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a022edfd-a430-44ba-9256-61b079ff961e', 'volume_size': 1, 'snapshot_id': '9dd064be-43dd-4c72-ad29-478785fc3542'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55573673-0f90-499d-9a33-fbd8af153e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:25:48 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Volume volume-a022edfd-a430-44ba-9256-61b079ff961e (a022edfd-a430-44ba-9256-61b079ff961e): created successfully
Apr 28 02:25:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55573673-0f90-499d-9a33-fbd8af153e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:25:48 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Flow 'volume_create_manager' (9d219744-7914-48ba-8b98-527f32c58c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:25:48 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-4de1ed2d-23dd-4ac9-8796-bae8a9f0dd58 tempest-VolumesSnapshotTestJSON-253046103 None] Created volume successfully.
Apr 28 02:25:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-a022edfd-a430-44ba-9256-61b079ff961e-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-a022edfd-a430-44ba-9256-61b079ff961e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-a022edfd-a430-44ba-9256-61b079ff961e" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:49 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-a022edfd-a430-44ba-9256-61b079ff961e" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:49 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf933db8-9dfb-4e96-bb15-d43cfaad7a2e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:49 devstack sudo[89342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e
Apr 28 02:25:49 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:49 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e" returned: 0 in 0.507s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:49 devstack sudo[89347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e
Apr 28 02:25:49 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:50 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a022edfd-a430-44ba-9256-61b079ff961e" returned: 0 in 0.448s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-a022edfd-a430-44ba-9256-61b079ff961e" released by "delete_volume" :: held 0.997s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:50 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Created reservations ['65b3a554-c5c1-43dd-89a9-9af3ced7fa5e', '2171a71d-9e00-495f-8604-46d27e3d0e7c', '2f19c469-68f7-4a2f-b530-059295a5f5db', 'f2091df6-8f2e-4f49-9cd5-c2c3234810b8'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:25:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:50 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:25:50 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:50 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.421s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:50 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:25:50 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Deleted volume successfully.
Apr 28 02:25:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9af0348b-2f96-4ee1-b018-f8486cf168f5 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-a022edfd-a430-44ba-9256-61b079ff961e-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-9dd064be-43dd-4c72-ad29-478785fc3542-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-9dd064be-43dd-4c72-ad29-478785fc3542-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-597f7e1f-120a-464f-9b9e-80720e01d1a6" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-597f7e1f-120a-464f-9b9e-80720e01d1a6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-9dd064be-43dd-4c72-ad29-478785fc3542" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-9dd064be-43dd-4c72-ad29-478785fc3542" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Deleting offline snapshot 9dd064be-43dd-4c72-ad29-478785fc3542 of volume 597f7e1f-120a-464f-9b9e-80720e01d1a6 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] snapshot_file for this snap is: volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6760992a-3def-47fa-ae1a-9c5febcbdac7]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:51 devstack sudo[89353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542
Apr 28 02:25:51 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:51 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542" returned: 0 in 0.505s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-597f7e1f-120a-464f-9b9e-80720e01d1a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[624a6996-b526-491e-a0c4-7775c6af98d3]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:52 devstack sudo[89358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6
Apr 28 02:25:52 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:52 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6" returned: 0 in 0.491s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:52 devstack sudo[89363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542
Apr 28 02:25:52 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:25:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:52 devstack sudo[89365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:25:52 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:52 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542" returned: 0 in 0.523s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:53 devstack sudo[89370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542
Apr 28 02:25:53 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:53 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.457s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:25:53 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6.9dd064be-43dd-4c72-ad29-478785fc3542" returned: 0 in 0.467s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-9dd064be-43dd-4c72-ad29-478785fc3542" released by "_delete_snapshot" :: held 2.117s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-597f7e1f-120a-464f-9b9e-80720e01d1a6" released by "delete_snapshot" :: held 2.142s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:53 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Created reservations ['fe6d5900-3755-441b-b45b-d4183b85b604', '7e557fb3-a7f7-4726-91a7-696ff56feb57', 'bab7d854-09e9-4440-aabb-83c3e7b0ae8f', 'bee5494c-aa4f-48ad-a202-507c2adb4871'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:25:53 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Delete snapshot completed successfully.
Apr 28 02:25:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-29129a38-afef-4503-9f47-5f3480d30277 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-9dd064be-43dd-4c72-ad29-478785fc3542-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-597f7e1f-120a-464f-9b9e-80720e01d1a6-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-597f7e1f-120a-464f-9b9e-80720e01d1a6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-597f7e1f-120a-464f-9b9e-80720e01d1a6" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-597f7e1f-120a-464f-9b9e-80720e01d1a6" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:54 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a613871c-9518-460f-978c-70be658d88a5]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:54 devstack sudo[89374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6
Apr 28 02:25:54 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:55 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6" returned: 0 in 0.513s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:55 devstack sudo[89379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6
Apr 28 02:25:55 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:55 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-597f7e1f-120a-464f-9b9e-80720e01d1a6" returned: 0 in 0.423s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:55 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-597f7e1f-120a-464f-9b9e-80720e01d1a6" released by "delete_volume" :: held 0.994s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:55 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Created reservations ['72c79283-ef42-4c1a-b801-59bd1814fda9', 'd3985fb7-ba9f-4545-8b47-8bab762d95f5', '45e60217-e031-47d2-a541-6a2075a2e2c6', '471091ba-b045-4ebe-92e6-304ce04d23d3'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:25:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:55 devstack sudo[89382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:25:55 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:56 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.434s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:56 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:25:56 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Deleted volume successfully.
Apr 28 02:25:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-efcf5b68-272d-498b-bb7d-a3e5ebfe64e0 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-597f7e1f-120a-464f-9b9e-80720e01d1a6-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-7a594d59-0d0e-4b1d-8e68-9be6d340b155-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-7a594d59-0d0e-4b1d-8e68-9be6d340b155-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "cinder-quobyte-7a594d59-0d0e-4b1d-8e68-9be6d340b155" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:25:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-7a594d59-0d0e-4b1d-8e68-9be6d340b155" acquired by "delete_volume" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:25:56 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0184ffdb-ee41-4b36-822e-375f62ec2c82]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:25:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:57 devstack sudo[89385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155
Apr 28 02:25:57 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:57 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155" returned: 0 in 0.505s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:57 devstack sudo[89391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155
Apr 28 02:25:57 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:57 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7a594d59-0d0e-4b1d-8e68-9be6d340b155" returned: 0 in 0.424s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-quobyte-7a594d59-0d0e-4b1d-8e68-9be6d340b155" released by "delete_volume" :: held 0.985s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:25:57 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Created reservations ['263dd706-80c7-4d09-b74a-dc67d315ec3e', '467a861c-d506-49cf-b930-2172de03e523', 'f18934b7-a216-41e7-9c75-4606d624643f', '67c9a410-479e-4f07-a5cd-4f3a4245ec5d'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:25:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:25:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:25:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:25:58 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:25:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:25:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:25:58 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:25:58 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:25:58 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Apr 28 02:25:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.435s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:25:58 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:25:58 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Deleted volume successfully.
Apr 28 02:25:58 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-21852d70-72ab-4006-9e62-5b0077748b00 tempest-VolumesSnapshotTestJSON-253046103 None] Lock "cinder-7a594d59-0d0e-4b1d-8e68-9be6d340b155-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Flow 'volume_create_manager' (abfdc8b0-9fb1-40cc-9606-dab09a1bff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89aaac4f-05ca-4e9f-9b25-8e7ad5bbcab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89aaac4f-05ca-4e9f-9b25-8e7ad5bbcab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2121066878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c029296-1164-4981-acb2-2592d3645f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae35a41d2abc4ce78cd6b5645633c140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:04Z,use_quota=True,user_id='815de57983b2441e8895722b9cbdb9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51dc1775-2183-403d-a966-c4693cf53774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51dc1775-2183-403d-a966-c4693cf53774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cfe315-1906-4a1c-9021-fade7086b83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cfe315-1906-4a1c-9021-fade7086b83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c029296-1164-4981-acb2-2592d3645f95', 'volume_name': 'volume-7c029296-1164-4981-acb2-2592d3645f95', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c9d309-d5e1-4748-938a-073dd49d16b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c9d309-d5e1-4748-938a-073dd49d16b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6033c2-997a-4dfa-b6af-dc8ca2c1425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:04 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume 7c029296-1164-4981-acb2-2592d3645f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c029296-1164-4981-acb2-2592d3645f95', 'volume_size': 1}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2121066878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c029296-1164-4981-acb2-2592d3645f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae35a41d2abc4ce78cd6b5645633c140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:04Z,use_quota=True,user_id='815de57983b2441e8895722b9cbdb9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Creating volume 7c029296-1164-4981-acb2-2592d3645f95 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:26:04 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:04 devstack sudo[89400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95 1073741824
Apr 28 02:26:04 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:04 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95 1073741824" returned: 0 in 0.581s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:04 devstack sudo[89405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95
Apr 28 02:26:04 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:05 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95" returned: 0 in 0.443s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:26:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6033c2-997a-4dfa-b6af-dc8ca2c1425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c029296-1164-4981-acb2-2592d3645f95', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d91209-f5bc-4746-9fc2-af93060328e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:05 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume volume-7c029296-1164-4981-acb2-2592d3645f95 (7c029296-1164-4981-acb2-2592d3645f95): created successfully
Apr 28 02:26:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d91209-f5bc-4746-9fc2-af93060328e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Flow 'volume_create_manager' (abfdc8b0-9fb1-40cc-9606-dab09a1bff77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:05 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f947d6b5-68d4-4549-9f47-2a6941d16e66 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Created volume successfully.
Apr 28 02:26:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:06 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] Creating offline snapshot 59c0a092-809b-4909-a812-5be506b8bffc of volume 7c029296-1164-4981-acb2-2592d3645f95 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:26:06 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ad7802-b020-42fa-9155-0369af0aedc5]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:06 devstack sudo[89408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95
Apr 28 02:26:06 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:07 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95" returned: 0 in 0.511s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:07 devstack sudo[89413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc 1G
Apr 28 02:26:07 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:07 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc 1G" returned: 0 in 0.560s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c029296-1164-4981-acb2-2592d3645f95 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:07 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c029296-1164-4981-acb2-2592d3645f95 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc
Apr 28 02:26:07 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:08 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c029296-1164-4981-acb2-2592d3645f95 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc" returned: 0 in 0.476s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:08 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc is being set with open permissions: ugo+rw
Apr 28 02:26:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:08 devstack sudo[89424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc
Apr 28 02:26:08 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:08 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc" returned: 0 in 0.428s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:08 devstack sudo[89427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.info
Apr 28 02:26:08 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:08 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.info" returned: 0 in 0.442s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:08 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.info is being set with open permissions: ugo+rw
Apr 28 02:26:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:08 devstack sudo[89430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.info
Apr 28 02:26:08 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:09 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.info" returned: 0 in 0.427s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.927s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:09 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-0575184c-d79d-424d-bafb-83bde98d3a1f tempest-CreateVolumesFromSnapshotTest-1392567509 None] Create snapshot completed successfully
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Flow 'volume_create_manager' (3ae164f8-000e-4876-9e41-1f64b69d3454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9c3217-d832-4d59-8662-8eee724f4853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9c3217-d832-4d59-8662-8eee724f4853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-959169129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c9eef7-d9cd-4fa1-835f-1bcd02827311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae35a41d2abc4ce78cd6b5645633c140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:10Z,use_quota=True,user_id='815de57983b2441e8895722b9cbdb9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee828db-f1bb-49fd-b3ff-c14a1b29c225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee828db-f1bb-49fd-b3ff-c14a1b29c225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ea0f81-ae1f-432f-a1b4-425903366660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ea0f81-ae1f-432f-a1b4-425903366660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c9eef7-d9cd-4fa1-835f-1bcd02827311', 'volume_name': 'volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee00dd9-e9a1-4c7c-8557-0f2e8ba58bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee00dd9-e9a1-4c7c-8557-0f2e8ba58bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4741486-9914-44ea-aa15-b3e56ca0e326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:09 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume 83c9eef7-d9cd-4fa1-835f-1bcd02827311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311', 'volume_size': 1}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-959169129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c9eef7-d9cd-4fa1-835f-1bcd02827311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae35a41d2abc4ce78cd6b5645633c140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:10Z,use_quota=True,user_id='815de57983b2441e8895722b9cbdb9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Creating volume 83c9eef7-d9cd-4fa1-835f-1bcd02827311 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:26:09 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:26:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:10 devstack sudo[89433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311 1073741824
Apr 28 02:26:10 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Flow 'volume_create_manager' (18d21a06-5b35-4ac6-b34a-b4d211b69a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc7801c-a504-4fb6-8458-b58ea7b1173d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc7801c-a504-4fb6-8458-b58ea7b1173d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-175992565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ec4e69-ed7d-4c35-8eac-97323b147b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae35a41d2abc4ce78cd6b5645633c140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:10Z,use_quota=True,user_id='815de57983b2441e8895722b9cbdb9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e772d41-8bfd-4abe-944e-cb7fb8311df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e772d41-8bfd-4abe-944e-cb7fb8311df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9f47cb-af1b-4328-813b-b293adaadd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9f47cb-af1b-4328-813b-b293adaadd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ec4e69-ed7d-4c35-8eac-97323b147b2e', 'volume_name': 'volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d75dba-9ac9-4074-8b34-a1cadd114326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d75dba-9ac9-4074-8b34-a1cadd114326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c440647-d166-47e9-ad6d-f66f13bf262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume 11ec4e69-ed7d-4c35-8eac-97323b147b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e', 'volume_size': 1}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Flow 'volume_create_manager' (589eb59c-f0d0-4949-ad28-af00a945a6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f038d69f-11cb-4db3-88cb-a24d6368f4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f038d69f-11cb-4db3-88cb-a24d6368f4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1189482206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b309f5-e33c-4d69-be96-945b0680b144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae35a41d2abc4ce78cd6b5645633c140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:10Z,use_quota=True,user_id='815de57983b2441e8895722b9cbdb9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa68cd6-8704-4ee4-9845-693a0b8c7cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa68cd6-8704-4ee4-9845-693a0b8c7cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e20bd7-48b7-4608-9624-c241ad0edd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e20bd7-48b7-4608-9624-c241ad0edd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b309f5-e33c-4d69-be96-945b0680b144', 'volume_name': 'volume-d0b309f5-e33c-4d69-be96-945b0680b144', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b317e4-b4bd-4ae1-b3ad-e6a847e9555e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b317e4-b4bd-4ae1-b3ad-e6a847e9555e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1050d6-6f3e-46e0-aaab-1023d6283679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume d0b309f5-e33c-4d69-be96-945b0680b144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b309f5-e33c-4d69-be96-945b0680b144', 'volume_size': 1}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:10 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311 1073741824" returned: 0 in 0.709s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:10 devstack sudo[89438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311
Apr 28 02:26:10 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Flow 'volume_create_manager' (ef8b4223-7afc-4190-b9d1-d1822aa6133e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e362d7b4-8f27-4b89-9f37-62574b77cf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e362d7b4-8f27-4b89-9f37-62574b77cf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1159376087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91184f98-d2ba-46d4-8826-361bfe867a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae35a41d2abc4ce78cd6b5645633c140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:11Z,use_quota=True,user_id='815de57983b2441e8895722b9cbdb9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a67f48-ef84-4d8a-b5db-bf37cbfeb453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a67f48-ef84-4d8a-b5db-bf37cbfeb453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d793973-a627-432b-a15f-b06d79e1e1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d793973-a627-432b-a15f-b06d79e1e1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91184f98-d2ba-46d4-8826-361bfe867a0a', 'volume_name': 'volume-91184f98-d2ba-46d4-8826-361bfe867a0a', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355edab5-e855-4967-98ed-31a52444fd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355edab5-e855-4967-98ed-31a52444fd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d490b2e-68c2-4b71-be5b-5845e6bbf0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:10 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume 91184f98-d2ba-46d4-8826-361bfe867a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91184f98-d2ba-46d4-8826-361bfe867a0a', 'volume_size': 1}
Apr 28 02:26:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Flow 'volume_create_manager' (d05ce4b6-1b3d-4b20-970c-2f7ed9f74bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c989024c-df29-4a1e-8aa4-6487e353c318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c989024c-df29-4a1e-8aa4-6487e353c318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145885649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e018104d-a8e2-49da-a314-a04b6ab72bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae35a41d2abc4ce78cd6b5645633c140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:11Z,use_quota=True,user_id='815de57983b2441e8895722b9cbdb9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b119d1-0ac2-4f0a-b074-3ff3b0bfc384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b119d1-0ac2-4f0a-b074-3ff3b0bfc384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee43beb-4bcd-470f-aa69-b8f01a6c9cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee43beb-4bcd-470f-aa69-b8f01a6c9cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e018104d-a8e2-49da-a314-a04b6ab72bc9', 'volume_name': 'volume-e018104d-a8e2-49da-a314-a04b6ab72bc9', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b310737f-50fb-4e0e-8857-7c873f8c348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b310737f-50fb-4e0e-8857-7c873f8c348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e217f50-c76e-47c2-bf1c-d718a402bbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:11 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume e018104d-a8e2-49da-a314-a04b6ab72bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e018104d-a8e2-49da-a314-a04b6ab72bc9', 'volume_size': 1}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:11 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311" returned: 0 in 0.504s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.969s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-175992565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ec4e69-ed7d-4c35-8eac-97323b147b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae35a41d2abc4ce78cd6b5645633c140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:10Z,use_quota=True,user_id='815de57983b2441e8895722b9cbdb9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Creating volume 11ec4e69-ed7d-4c35-8eac-97323b147b2e {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:26:11 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4741486-9914-44ea-aa15-b3e56ca0e326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:11 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e 1073741824
Apr 28 02:26:11 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f47b8af-d2aa-4847-94ff-e2de13ccb30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:11 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311 (83c9eef7-d9cd-4fa1-835f-1bcd02827311): created successfully
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f47b8af-d2aa-4847-94ff-e2de13ccb30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Flow 'volume_create_manager' (3ae164f8-000e-4876-9e41-1f64b69d3454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:11 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-c46e7469-d022-4ed7-84eb-ac0d52beb9ca tempest-CreateVolumesFromSnapshotTest-1392567509 None] Created volume successfully.
Apr 28 02:26:11 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e 1073741824" returned: 0 in 0.592s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:11 devstack sudo[89446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e
Apr 28 02:26:11 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:12 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e" returned: 0 in 0.446s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.753s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1189482206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b309f5-e33c-4d69-be96-945b0680b144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae35a41d2abc4ce78cd6b5645633c140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:10Z,use_quota=True,user_id='815de57983b2441e8895722b9cbdb9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Creating volume d0b309f5-e33c-4d69-be96-945b0680b144 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:26:12 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d0b309f5-e33c-4d69-be96-945b0680b144 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c440647-d166-47e9-ad6d-f66f13bf262d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:12 devstack sudo[89449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d0b309f5-e33c-4d69-be96-945b0680b144 1073741824
Apr 28 02:26:12 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaa80f0-12bd-4192-ae91-d470c148b7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:12 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e (11ec4e69-ed7d-4c35-8eac-97323b147b2e): created successfully
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaa80f0-12bd-4192-ae91-d470c148b7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Flow 'volume_create_manager' (18d21a06-5b35-4ac6-b34a-b4d211b69a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:12 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-c957a161-ff74-4bf0-b032-c0c45296d840 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Created volume successfully.
Apr 28 02:26:12 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d0b309f5-e33c-4d69-be96-945b0680b144 1073741824" returned: 0 in 0.592s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=83,cinder:INSERT=31,cinder:UPDATE=109,cinder:DELETE=6 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=92,cinder:UPDATE=100,cinder:INSERT=22,cinder:DELETE=12 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:26:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d0b309f5-e33c-4d69-be96-945b0680b144 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:12 devstack sudo[89454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d0b309f5-e33c-4d69-be96-945b0680b144
Apr 28 02:26:12 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:13 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d0b309f5-e33c-4d69-be96-945b0680b144" returned: 0 in 0.460s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.546s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1159376087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91184f98-d2ba-46d4-8826-361bfe867a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae35a41d2abc4ce78cd6b5645633c140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:11Z,use_quota=True,user_id='815de57983b2441e8895722b9cbdb9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Creating volume 91184f98-d2ba-46d4-8826-361bfe867a0a {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:26:13 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91184f98-d2ba-46d4-8826-361bfe867a0a 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1050d6-6f3e-46e0-aaab-1023d6283679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b309f5-e33c-4d69-be96-945b0680b144', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:13 devstack sudo[89457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91184f98-d2ba-46d4-8826-361bfe867a0a 1073741824
Apr 28 02:26:13 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cae6c0-a261-4478-aaf3-5a7377679bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:13 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume volume-d0b309f5-e33c-4d69-be96-945b0680b144 (d0b309f5-e33c-4d69-be96-945b0680b144): created successfully
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cae6c0-a261-4478-aaf3-5a7377679bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Flow 'volume_create_manager' (589eb59c-f0d0-4949-ad28-af00a945a6d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:13 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a8db2c69-38c7-45b8-8161-12c0564b128b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Created volume successfully.
Apr 28 02:26:14 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91184f98-d2ba-46d4-8826-361bfe867a0a 1073741824" returned: 0 in 0.607s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91184f98-d2ba-46d4-8826-361bfe867a0a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:14 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91184f98-d2ba-46d4-8826-361bfe867a0a
Apr 28 02:26:14 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:14 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91184f98-d2ba-46d4-8826-361bfe867a0a" returned: 0 in 0.438s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.405s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145885649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e018104d-a8e2-49da-a314-a04b6ab72bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae35a41d2abc4ce78cd6b5645633c140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:11Z,use_quota=True,user_id='815de57983b2441e8895722b9cbdb9b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Creating volume e018104d-a8e2-49da-a314-a04b6ab72bc9 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:26:14 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e018104d-a8e2-49da-a314-a04b6ab72bc9 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:14 devstack sudo[89465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e018104d-a8e2-49da-a314-a04b6ab72bc9 1073741824
Apr 28 02:26:14 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d490b2e-68c2-4b71-be5b-5845e6bbf0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91184f98-d2ba-46d4-8826-361bfe867a0a', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2db2082-1e06-4de2-bca6-9ab382740f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:14 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume volume-91184f98-d2ba-46d4-8826-361bfe867a0a (91184f98-d2ba-46d4-8826-361bfe867a0a): created successfully
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2db2082-1e06-4de2-bca6-9ab382740f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Flow 'volume_create_manager' (ef8b4223-7afc-4190-b9d1-d1822aa6133e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:14 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-e7508bba-c387-499e-abda-4b5e4d4901a8 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Created volume successfully.
Apr 28 02:26:15 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e018104d-a8e2-49da-a314-a04b6ab72bc9 1073741824" returned: 0 in 0.588s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e018104d-a8e2-49da-a314-a04b6ab72bc9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:15 devstack sudo[89470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e018104d-a8e2-49da-a314-a04b6ab72bc9
Apr 28 02:26:15 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:15 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e018104d-a8e2-49da-a314-a04b6ab72bc9" returned: 0 in 0.445s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:26:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e217f50-c76e-47c2-bf1c-d718a402bbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e018104d-a8e2-49da-a314-a04b6ab72bc9', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d158d4e-5f51-4939-858e-bfe69392dd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:15 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Volume volume-e018104d-a8e2-49da-a314-a04b6ab72bc9 (e018104d-a8e2-49da-a314-a04b6ab72bc9): created successfully
Apr 28 02:26:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d158d4e-5f51-4939-858e-bfe69392dd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Flow 'volume_create_manager' (d05ce4b6-1b3d-4b20-970c-2f7ed9f74bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:15 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ae025673-4cdc-439f-94ad-01465a3cb7fd tempest-CreateVolumesFromSnapshotTest-1392567509 None] Created volume successfully.
Apr 28 02:26:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-e018104d-a8e2-49da-a314-a04b6ab72bc9-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-e018104d-a8e2-49da-a314-a04b6ab72bc9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-quobyte-e018104d-a8e2-49da-a314-a04b6ab72bc9" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-e018104d-a8e2-49da-a314-a04b6ab72bc9" acquired by "delete_volume" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:16 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edfb08e-4a14-4fa5-9ebc-1dd7812317f8]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e018104d-a8e2-49da-a314-a04b6ab72bc9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:16 devstack sudo[89473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e018104d-a8e2-49da-a314-a04b6ab72bc9
Apr 28 02:26:16 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:17 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e018104d-a8e2-49da-a314-a04b6ab72bc9" returned: 0 in 0.504s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e018104d-a8e2-49da-a314-a04b6ab72bc9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:17 devstack sudo[89478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e018104d-a8e2-49da-a314-a04b6ab72bc9
Apr 28 02:26:17 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:17 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e018104d-a8e2-49da-a314-a04b6ab72bc9" returned: 0 in 0.430s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:17 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-e018104d-a8e2-49da-a314-a04b6ab72bc9" released by "delete_volume" :: held 0.977s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:17 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Created reservations ['b70e98c6-a5d5-4d82-b1b1-6cf7f86460a9', '9bfc27ae-c8ad-4d7d-974e-f68db9fbb072', '29186ce5-e264-46ac-9095-9b0ba1f4d3a3', 'cc3ba838-6c68-42ec-89c9-0b8396440025'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:26:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:17 devstack sudo[89482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:26:17 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:18 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.417s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:18 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:26:18 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Deleted volume successfully.
Apr 28 02:26:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9ad233ec-c27a-4c87-a83b-c79d615bd1be tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-e018104d-a8e2-49da-a314-a04b6ab72bc9-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-91184f98-d2ba-46d4-8826-361bfe867a0a-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-91184f98-d2ba-46d4-8826-361bfe867a0a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-quobyte-91184f98-d2ba-46d4-8826-361bfe867a0a" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-91184f98-d2ba-46d4-8826-361bfe867a0a" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:18 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[92287fd7-e1e8-4dc6-b7ad-d76ed5d6f085]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91184f98-d2ba-46d4-8826-361bfe867a0a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:18 devstack sudo[89485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91184f98-d2ba-46d4-8826-361bfe867a0a
Apr 28 02:26:18 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:19 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91184f98-d2ba-46d4-8826-361bfe867a0a" returned: 0 in 0.502s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91184f98-d2ba-46d4-8826-361bfe867a0a {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:19 devstack sudo[89490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91184f98-d2ba-46d4-8826-361bfe867a0a
Apr 28 02:26:19 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:19 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-91184f98-d2ba-46d4-8826-361bfe867a0a" returned: 0 in 0.422s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:19 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-91184f98-d2ba-46d4-8826-361bfe867a0a" released by "delete_volume" :: held 0.963s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:19 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Created reservations ['fe9618fe-2cd6-480b-8436-33519eb3363f', '35d2ca39-3d8b-43fd-a56f-8fc66fdf9d1b', 'da1ae05f-2150-44c6-983e-fda85f2f2f2c', '848754c3-e841-4099-8db3-41d89d15d90b'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:26:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:19 devstack sudo[89493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:26:19 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:20 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.438s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:20 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:26:20 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Deleted volume successfully.
Apr 28 02:26:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ccbbd5af-50cf-4d5b-bd42-9623df85555c tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-91184f98-d2ba-46d4-8826-361bfe867a0a-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-d0b309f5-e33c-4d69-be96-945b0680b144-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-d0b309f5-e33c-4d69-be96-945b0680b144-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:21 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-quobyte-d0b309f5-e33c-4d69-be96-945b0680b144" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:21 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-d0b309f5-e33c-4d69-be96-945b0680b144" acquired by "delete_volume" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:21 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b0d4d0-1812-45f8-a79c-37afb9b4ae81]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d0b309f5-e33c-4d69-be96-945b0680b144 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:21 devstack sudo[89496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d0b309f5-e33c-4d69-be96-945b0680b144
Apr 28 02:26:21 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:21 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d0b309f5-e33c-4d69-be96-945b0680b144" returned: 0 in 0.511s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d0b309f5-e33c-4d69-be96-945b0680b144 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:21 devstack sudo[89507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d0b309f5-e33c-4d69-be96-945b0680b144
Apr 28 02:26:21 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:21 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d0b309f5-e33c-4d69-be96-945b0680b144" returned: 0 in 0.432s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-d0b309f5-e33c-4d69-be96-945b0680b144" released by "delete_volume" :: held 0.981s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:22 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Created reservations ['876c9deb-9a82-456b-95c6-7efb2ed2faa2', 'c5ef2190-dcdf-41db-8a43-7d1fc00db8c4', '31a697d9-a566-4d24-9b16-8d8830b67f05', 'b3b580f3-be31-4d2b-8e8c-b5c068b1cfca'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:26:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:22 devstack sudo[89510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:26:22 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:22 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.436s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:22 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:26:22 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Deleted volume successfully.
Apr 28 02:26:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-62bddeb5-e60c-455f-8a09-76c0ec5974cc tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-d0b309f5-e33c-4d69-be96-945b0680b144-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-11ec4e69-ed7d-4c35-8eac-97323b147b2e-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-11ec4e69-ed7d-4c35-8eac-97323b147b2e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-quobyte-11ec4e69-ed7d-4c35-8eac-97323b147b2e" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-11ec4e69-ed7d-4c35-8eac-97323b147b2e" acquired by "delete_volume" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:23 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb76ea7b-ff1c-4846-b3a3-e6e96dcf6d15]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:23 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e
Apr 28 02:26:23 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:23 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e" returned: 0 in 0.523s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:23 devstack sudo[89518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e
Apr 28 02:26:23 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:24 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11ec4e69-ed7d-4c35-8eac-97323b147b2e" returned: 0 in 0.419s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-11ec4e69-ed7d-4c35-8eac-97323b147b2e" released by "delete_volume" :: held 0.984s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:24 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Created reservations ['19217097-9319-48ad-9731-c1bae8039af0', 'd521643a-4220-4a9c-99c7-2851bbf028ee', '8a32a0cd-f393-4dfe-bea0-fddb9dc7700b', '49c9a390-30b2-41ce-8f41-2196746f2d2c'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:26:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:24 devstack sudo[89521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:26:24 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:24 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.428s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:24 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:26:24 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Deleted volume successfully.
Apr 28 02:26:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-cea401be-a407-4790-b3c0-ecabe3b24adf tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-11ec4e69-ed7d-4c35-8eac-97323b147b2e-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-83c9eef7-d9cd-4fa1-835f-1bcd02827311-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-83c9eef7-d9cd-4fa1-835f-1bcd02827311-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-quobyte-83c9eef7-d9cd-4fa1-835f-1bcd02827311" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:25 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-83c9eef7-d9cd-4fa1-835f-1bcd02827311" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:25 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[2487e461-eeb9-4dfb-852e-49682fc3b8e3]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:25 devstack sudo[89524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311
Apr 28 02:26:25 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:25 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311" returned: 0 in 0.523s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:26 devstack sudo[89530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311
Apr 28 02:26:26 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:26 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c9eef7-d9cd-4fa1-835f-1bcd02827311" returned: 0 in 0.438s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:26 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-83c9eef7-d9cd-4fa1-835f-1bcd02827311" released by "delete_volume" :: held 1.011s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:26 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Created reservations ['9fd8b691-1b67-42be-9187-897007db2dd5', '3b504e9c-0e63-4ecf-95dc-8b1b98ecfb70', 'ee06bd8b-fe99-4433-ae9a-ecf653d61702', '57a4b5b3-0e32-4d27-8776-c0763c5c0191'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:26:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:26 devstack sudo[89533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:26:26 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:27 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.454s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:27 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:26:27 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Deleted volume successfully.
Apr 28 02:26:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70e23acc-193e-435c-a61e-aa03d9f90642 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-83c9eef7-d9cd-4fa1-835f-1bcd02827311-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-59c0a092-809b-4909-a812-5be506b8bffc-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-59c0a092-809b-4909-a812-5be506b8bffc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-quobyte-7c029296-1164-4981-acb2-2592d3645f95" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-7c029296-1164-4981-acb2-2592d3645f95" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-quobyte-59c0a092-809b-4909-a812-5be506b8bffc" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-59c0a092-809b-4909-a812-5be506b8bffc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Deleting offline snapshot 59c0a092-809b-4909-a812-5be506b8bffc of volume 7c029296-1164-4981-acb2-2592d3645f95 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:26:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] snapshot_file for this snap is: volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:26:27 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e080e4b-9a7b-478e-bb4c-a2a6efe5ec01]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:27 devstack sudo[89537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc
Apr 28 02:26:27 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:28 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc" returned: 0 in 0.516s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c029296-1164-4981-acb2-2592d3645f95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:26:28 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e697270-15d4-47ba-ad23-e0f058922fb7]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:28 devstack sudo[89544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95
Apr 28 02:26:28 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:28 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95" returned: 0 in 0.516s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:28 devstack sudo[89549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc
Apr 28 02:26:28 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:29 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc" returned: 0 in 0.510s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:29 devstack sudo[89554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc
Apr 28 02:26:29 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:29 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95.59c0a092-809b-4909-a812-5be506b8bffc" returned: 0 in 0.440s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-59c0a092-809b-4909-a812-5be506b8bffc" released by "_delete_snapshot" :: held 2.084s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-7c029296-1164-4981-acb2-2592d3645f95" released by "delete_snapshot" :: held 2.107s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:29 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Created reservations ['44a8b9c5-9a2a-4b56-a8a0-d1a2bdf44ccd', '5621d3e7-536e-43e6-b0c9-075e99000506', '23450db5-4dab-4d7e-ac27-d74efc208f59', 'bb9fa9c5-2506-414f-b868-db32a45d3bf9'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:26:29 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Delete snapshot completed successfully.
Apr 28 02:26:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c0633b8f-7eca-4b52-969b-5caaaf303a7b tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-59c0a092-809b-4909-a812-5be506b8bffc-delete_snapshot" released by "delete_snapshot" :: held 2.233s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:30 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-7c029296-1164-4981-acb2-2592d3645f95-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:30 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-7c029296-1164-4981-acb2-2592d3645f95-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:30 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "cinder-quobyte-7c029296-1164-4981-acb2-2592d3645f95" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:30 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-7c029296-1164-4981-acb2-2592d3645f95" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:30 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79c0c4b-a711-4e6d-a445-411785e3d124]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:30 devstack sudo[89557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95
Apr 28 02:26:30 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:31 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95" returned: 0 in 0.504s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:31 devstack sudo[89562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95
Apr 28 02:26:31 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:31 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-7c029296-1164-4981-acb2-2592d3645f95" returned: 0 in 0.434s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-quobyte-7c029296-1164-4981-acb2-2592d3645f95" released by "delete_volume" :: held 1.002s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:31 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Created reservations ['60e6deef-ceda-43a1-9dd1-ca0de6c4b9c6', '533a3bf5-320a-4d15-85ce-92098aec86f4', '39e7f4d4-0e60-4aef-a971-389eac0e195b', '7d0c9e43-0357-454d-8333-b851be93b2cc'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:26:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:31 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:31 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:31 devstack sudo[89565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:26:31 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:32 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.425s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:32 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:26:32 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Deleted volume successfully.
Apr 28 02:26:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b664d7fd-a7e6-4812-811a-7118774d13b5 tempest-CreateVolumesFromSnapshotTest-1392567509 None] Lock "cinder-7c029296-1164-4981-acb2-2592d3645f95-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Flow 'volume_create_manager' (0f13b0cf-da67-4b75-b9c0-f68417080dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a11685b-faf3-4dc5-aff3-febf28209621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a11685b-faf3-4dc5-aff3-febf28209621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-582331946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbe481e-2273-4236-907d-04e265790623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cfbab8c29d4a40aab650bfdd01b1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:35Z,use_quota=True,user_id='53f1a688d78d4c00af4492162ff16e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e77c4e-8914-40d7-abd1-4ec912188ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e77c4e-8914-40d7-abd1-4ec912188ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f1c889-6b02-46c3-aa28-81daf38b8265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60f1c889-6b02-46c3-aa28-81daf38b8265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bbe481e-2273-4236-907d-04e265790623', 'volume_name': 'volume-0bbe481e-2273-4236-907d-04e265790623', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1d78a3-4d52-4732-83a3-85c4e371642c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1d78a3-4d52-4732-83a3-85c4e371642c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bbb156-2998-41bb-8090-7e115fd0ec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:35 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Volume 0bbe481e-2273-4236-907d-04e265790623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bbe481e-2273-4236-907d-04e265790623', 'volume_size': 1}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-582331946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbe481e-2273-4236-907d-04e265790623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cfbab8c29d4a40aab650bfdd01b1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:35Z,use_quota=True,user_id='53f1a688d78d4c00af4492162ff16e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Creating volume 0bbe481e-2273-4236-907d-04e265790623 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:26:35 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:35 devstack sudo[89569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 1073741824
Apr 28 02:26:35 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:35 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 1073741824" returned: 0 in 0.602s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:35 devstack sudo[89574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623
Apr 28 02:26:35 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:36 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623" returned: 0 in 0.431s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:26:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bbb156-2998-41bb-8090-7e115fd0ec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bbe481e-2273-4236-907d-04e265790623', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab5e480-8e17-4764-a641-7924da72fa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:36 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Volume volume-0bbe481e-2273-4236-907d-04e265790623 (0bbe481e-2273-4236-907d-04e265790623): created successfully
Apr 28 02:26:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab5e480-8e17-4764-a641-7924da72fa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:36 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Flow 'volume_create_manager' (0f13b0cf-da67-4b75-b9c0-f68417080dba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:36 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-0ad27e45-f3d6-413d-82cb-1acbb2a850e8 tempest-VolumeDependencyTests-1021423530 None] Created volume successfully.
Apr 28 02:26:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:37 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] Creating offline snapshot 5f5af798-3599-4586-b4b4-28daf39e5f5f of volume 0bbe481e-2273-4236-907d-04e265790623 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:26:37 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ecedfa-8741-49ae-913d-c427515f2080]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:37 devstack sudo[89578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623
Apr 28 02:26:37 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:38 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623" returned: 0 in 0.516s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:38 devstack sudo[89583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f 1G
Apr 28 02:26:38 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:38 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f 1G" returned: 0 in 0.586s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bbe481e-2273-4236-907d-04e265790623 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:38 devstack sudo[89588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bbe481e-2273-4236-907d-04e265790623 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f
Apr 28 02:26:38 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:39 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bbe481e-2273-4236-907d-04e265790623 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f" returned: 0 in 0.471s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:39 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f is being set with open permissions: ugo+rw
Apr 28 02:26:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:39 devstack sudo[89593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f
Apr 28 02:26:39 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:39 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f" returned: 0 in 0.429s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:39 devstack sudo[89596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.info
Apr 28 02:26:39 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:40 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.info" returned: 0 in 0.438s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:40 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.info is being set with open permissions: ugo+rw
Apr 28 02:26:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:40 devstack sudo[89599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.info
Apr 28 02:26:40 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:40 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.info" returned: 0 in 0.438s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.961s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:40 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a784c1e3-cb8a-4675-9bcf-deca3279124d tempest-VolumeDependencyTests-1021423530 None] Create snapshot completed successfully
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Flow 'volume_create_manager' (a5baf695-16df-4099-9a63-6df36a647343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a093fdf-c23b-4416-b1c7-9450bd12ccb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a093fdf-c23b-4416-b1c7-9450bd12ccb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1152839560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2581bc9b-bd87-4248-bf01-e28569fd3028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cfbab8c29d4a40aab650bfdd01b1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5f5af798-3599-4586-b4b4-28daf39e5f5f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:41Z,use_quota=True,user_id='53f1a688d78d4c00af4492162ff16e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f39918e-360b-4c87-b7b2-8febbc055229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f39918e-360b-4c87-b7b2-8febbc055229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399d3412-d0b8-4a0a-aba0-5f0c90f128e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399d3412-d0b8-4a0a-aba0-5f0c90f128e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2581bc9b-bd87-4248-bf01-e28569fd3028', 'volume_name': 'volume-2581bc9b-bd87-4248-bf01-e28569fd3028', 'volume_size': 1, 'snapshot_id': '5f5af798-3599-4586-b4b4-28daf39e5f5f'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329da01b-808c-4889-81fe-ad06cb4eb231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329da01b-808c-4889-81fe-ad06cb4eb231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc5acb8-b05e-4f32-a07d-0278efe35464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:41 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Volume 2581bc9b-bd87-4248-bf01-e28569fd3028: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2581bc9b-bd87-4248-bf01-e28569fd3028', 'volume_size': 1, 'snapshot_id': '5f5af798-3599-4586-b4b4-28daf39e5f5f'}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-quobyte-5f5af798-3599-4586-b4b4-28daf39e5f5f-2581bc9b-bd87-4248-bf01-e28569fd3028" by "_create_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-5f5af798-3599-4586-b4b4-28daf39e5f5f-2581bc9b-bd87-4248-bf01-e28569fd3028" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Creating volume 2581bc9b-bd87-4248-bf01-e28569fd3028 from snapshot 5f5af798-3599-4586-b4b4-28daf39e5f5f {{(pid=81489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-quobyte-2581bc9b-bd87-4248-bf01-e28569fd3028" by "_copy_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-2581bc9b-bd87-4248-bf01-e28569fd3028" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] snapshot: 5f5af798-3599-4586-b4b4-28daf39e5f5f, volume: 2581bc9b-bd87-4248-bf01-e28569fd3028,  {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[668fa275-fb0e-4977-ae91-a48e024d463d]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:41 devstack sudo[89602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f
Apr 28 02:26:41 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:41 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f" returned: 0 in 0.528s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bbe481e-2273-4236-907d-04e265790623(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Creating direct copy from snapshot {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c38944c-8910-4105-a514-8692511d8ce1]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:41 devstack sudo[89607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623
Apr 28 02:26:41 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:42 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623" returned: 0 in 0.502s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:42 devstack cinder-volume[81489]: DEBUG cinder.utils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Path /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028 not found in is_blk_device check {{(pid=81489) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 02:26:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:42 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028
Apr 28 02:26:42 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:46 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028" returned: 0 in 4.354s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:46 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e77cc9-4742-474a-948f-ecc1fd37dc44]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:46 devstack sudo[89625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623
Apr 28 02:26:46 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:47 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623" returned: 0 in 0.638s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:47 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623, size 1024.00 MB, duration 4.35 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028 {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:26:47 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Converted 1024.00 MB image at 235.14 MB/s
Apr 28 02:26:47 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028 is being set with open permissions: ugo+rw
Apr 28 02:26:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:47 devstack sudo[89631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028
Apr 28 02:26:47 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:47 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028" returned: 0 in 0.430s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-2581bc9b-bd87-4248-bf01-e28569fd3028" released by "_copy_volume_from_snapshot" :: held 6.543s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-5f5af798-3599-4586-b4b4-28daf39e5f5f-2581bc9b-bd87-4248-bf01-e28569fd3028" released by "_create_volume_from_snapshot" :: held 6.574s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.588s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:47 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc5acb8-b05e-4f32-a07d-0278efe35464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2581bc9b-bd87-4248-bf01-e28569fd3028', 'volume_size': 1, 'snapshot_id': '5f5af798-3599-4586-b4b4-28daf39e5f5f'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:47 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9a2457-23fa-4f87-8257-7e66bf41afcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:47 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Volume volume-2581bc9b-bd87-4248-bf01-e28569fd3028 (2581bc9b-bd87-4248-bf01-e28569fd3028): created successfully
Apr 28 02:26:47 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa9a2457-23fa-4f87-8257-7e66bf41afcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:47 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Flow 'volume_create_manager' (a5baf695-16df-4099-9a63-6df36a647343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:47 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d5a00ded-db7c-42b5-9b37-7a20d6755c45 tempest-VolumeDependencyTests-1021423530 None] Created volume successfully.
Apr 28 02:26:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-5f5af798-3599-4586-b4b4-28daf39e5f5f-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-5f5af798-3599-4586-b4b4-28daf39e5f5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-quobyte-0bbe481e-2273-4236-907d-04e265790623" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-0bbe481e-2273-4236-907d-04e265790623" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-quobyte-5f5af798-3599-4586-b4b4-28daf39e5f5f" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-5f5af798-3599-4586-b4b4-28daf39e5f5f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Deleting offline snapshot 5f5af798-3599-4586-b4b4-28daf39e5f5f of volume 0bbe481e-2273-4236-907d-04e265790623 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:26:48 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] snapshot_file for this snap is: volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:26:48 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e543678f-2b36-4e70-b51b-c06079e49676]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:48 devstack sudo[89668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f
Apr 28 02:26:48 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:49 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f" returned: 0 in 0.516s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:49 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bbe481e-2273-4236-907d-04e265790623(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:26:49 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[055b2c99-0f8c-49f8-8e22-3c0396febc22]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:49 devstack sudo[89673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623
Apr 28 02:26:49 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:49 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623" returned: 0 in 0.516s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:49 devstack sudo[89678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f
Apr 28 02:26:49 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:50 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f" returned: 0 in 0.538s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:50 devstack sudo[89683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f
Apr 28 02:26:50 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:50 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623.5f5af798-3599-4586-b4b4-28daf39e5f5f" returned: 0 in 0.450s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-5f5af798-3599-4586-b4b4-28daf39e5f5f" released by "_delete_snapshot" :: held 2.109s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-0bbe481e-2273-4236-907d-04e265790623" released by "delete_snapshot" :: held 2.131s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:50 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Created reservations ['17120055-ab6a-410d-bde2-a7b73dae52c1', '513d255b-9e82-4d15-b22f-cd2cb7491b1f', 'a20fbf7a-459a-4247-9154-05a4a9ef5895', '98526709-0c2a-4fb4-9351-a619ed32abf9'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:26:50 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Delete snapshot completed successfully.
Apr 28 02:26:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9d555559-8e7f-483f-b389-563c563544f9 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-5f5af798-3599-4586-b4b4-28daf39e5f5f-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-0bbe481e-2273-4236-907d-04e265790623-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-0bbe481e-2273-4236-907d-04e265790623-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-quobyte-0bbe481e-2273-4236-907d-04e265790623" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-0bbe481e-2273-4236-907d-04e265790623" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:51 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[afce73a3-6b17-401c-8b33-a279f9b37b02]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:52 devstack sudo[89686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623
Apr 28 02:26:52 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:52 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623" returned: 0 in 0.510s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:52 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623
Apr 28 02:26:52 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:26:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:52 devstack sudo[89693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:26:52 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:52 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-0bbe481e-2273-4236-907d-04e265790623" returned: 0 in 0.458s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-0bbe481e-2273-4236-907d-04e265790623" released by "delete_volume" :: held 1.029s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:52 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Created reservations ['daf71e84-35cd-45d5-851b-5e5d35318b05', 'fbd32fc7-d954-42b9-b346-b582284c94b7', 'a010c7b4-22b8-4989-ba4d-332e20eba2ef', '5691781a-8c2a-49a1-b16f-b0e86a33f318'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:26:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:53 devstack sudo[89697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:26:53 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:53 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.453s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:26:53 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.446s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:26:53 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Deleted volume successfully.
Apr 28 02:26:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6730f1ae-85f6-4cef-9c0c-e56622778ef9 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-0bbe481e-2273-4236-907d-04e265790623-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Flow 'volume_create_manager' (a292e102-7279-4f22-aa7a-8c5a25dcbcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6406cbd7-09aa-4c15-b83a-0b4ae9e207d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6406cbd7-09aa-4c15-b83a-0b4ae9e207d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-633491559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5008e232-4a0d-4969-811c-1d07e695ff08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cfbab8c29d4a40aab650bfdd01b1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:54Z,use_quota=True,user_id='53f1a688d78d4c00af4492162ff16e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83254d73-5235-4274-ae85-06b614929878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83254d73-5235-4274-ae85-06b614929878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5deccda-097f-4909-81d1-76db72f42fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5deccda-097f-4909-81d1-76db72f42fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5008e232-4a0d-4969-811c-1d07e695ff08', 'volume_name': 'volume-5008e232-4a0d-4969-811c-1d07e695ff08', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40288c9-d5f5-498f-8831-240877c0b8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40288c9-d5f5-498f-8831-240877c0b8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aead31e-4a1f-42ef-bd32-bb89929e4666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:54 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Volume 5008e232-4a0d-4969-811c-1d07e695ff08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5008e232-4a0d-4969-811c-1d07e695ff08', 'volume_size': 1}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-633491559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5008e232-4a0d-4969-811c-1d07e695ff08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cfbab8c29d4a40aab650bfdd01b1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:54Z,use_quota=True,user_id='53f1a688d78d4c00af4492162ff16e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Creating volume 5008e232-4a0d-4969-811c-1d07e695ff08 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:26:54 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:54 devstack sudo[89700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 1073741824
Apr 28 02:26:54 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:54 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 1073741824" returned: 0 in 0.576s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:55 devstack sudo[89705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08
Apr 28 02:26:55 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:55 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08" returned: 0 in 0.452s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:26:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aead31e-4a1f-42ef-bd32-bb89929e4666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5008e232-4a0d-4969-811c-1d07e695ff08', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f2b9b4-c58e-4e1d-aa43-4b520f4482d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:55 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Volume volume-5008e232-4a0d-4969-811c-1d07e695ff08 (5008e232-4a0d-4969-811c-1d07e695ff08): created successfully
Apr 28 02:26:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f2b9b4-c58e-4e1d-aa43-4b520f4482d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Flow 'volume_create_manager' (a292e102-7279-4f22-aa7a-8c5a25dcbcf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:55 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f6fc14af-6946-4c72-8389-b1235a1d7980 tempest-VolumeDependencyTests-1021423530 None] Created volume successfully.
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Flow 'volume_create_manager' (1fe277e9-a51d-48fb-bbdc-054dd9c81217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23977145-4e2c-4f32-a54b-13cd1b076a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23977145-4e2c-4f32-a54b-13cd1b076a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2025408924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370c2c47-89a0-4a4d-8fdf-e72cd71e4ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3cfbab8c29d4a40aab650bfdd01b1f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=5008e232-4a0d-4969-811c-1d07e695ff08,status='creating',terminated_at=None,updated_at=2026-04-28T00:26:57Z,use_quota=True,user_id='53f1a688d78d4c00af4492162ff16e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d971b9fc-2c7d-4c43-a5d7-9c025d188eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d971b9fc-2c7d-4c43-a5d7-9c025d188eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83503d8-8fd3-429a-bf83-fba5a9fafdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83503d8-8fd3-429a-bf83-fba5a9fafdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '370c2c47-89a0-4a4d-8fdf-e72cd71e4ece', 'volume_name': 'volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece', 'volume_size': 1, 'source_volid': '5008e232-4a0d-4969-811c-1d07e695ff08', 'source_volstatus': 'available'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5472dd8f-9146-43c7-8611-7595ddf02c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5472dd8f-9146-43c7-8611-7595ddf02c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08914c64-c722-4b76-97eb-18d07dc97aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:26:56 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Volume 370c2c47-89a0-4a4d-8fdf-e72cd71e4ece: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece', 'volume_size': 1, 'source_volid': '5008e232-4a0d-4969-811c-1d07e695ff08', 'source_volstatus': 'available'}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:56 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Cloning volume 5008e232-4a0d-4969-811c-1d07e695ff08 to volume 370c2c47-89a0-4a4d-8fdf-e72cd71e4ece
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Creating offline snapshot e23a1fc3-952f-47f1-8123-d34b72096229 of volume 5008e232-4a0d-4969-811c-1d07e695ff08 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[248a38b6-b385-4128-b962-4933b50dca1e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:57 devstack sudo[89708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08
Apr 28 02:26:57 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:57 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08" returned: 0 in 0.508s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:57 devstack sudo[89714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229 1G
Apr 28 02:26:57 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:58 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229 1G" returned: 0 in 0.572s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5008e232-4a0d-4969-811c-1d07e695ff08 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:58 devstack sudo[89719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5008e232-4a0d-4969-811c-1d07e695ff08 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229
Apr 28 02:26:58 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:58 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5008e232-4a0d-4969-811c-1d07e695ff08 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229" returned: 0 in 0.481s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:58 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229 is being set with open permissions: ugo+rw
Apr 28 02:26:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:58 devstack sudo[89724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229
Apr 28 02:26:58 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:58 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229" returned: 0 in 0.431s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:58 devstack sudo[89727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.info
Apr 28 02:26:58 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:59 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.info" returned: 0 in 0.450s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:59 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.info is being set with open permissions: ugo+rw
Apr 28 02:26:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:59 devstack sudo[89730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.info
Apr 28 02:26:59 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:26:59 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root
Apr 28 02:26:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.info" returned: 0 in 0.423s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:26:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-quobyte-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece" by "_copy_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:26:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:26:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] snapshot: e23a1fc3-952f-47f1-8123-d34b72096229, volume: 370c2c47-89a0-4a4d-8fdf-e72cd71e4ece,  {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 02:26:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:26:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:26:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:26:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:26:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:26:59 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0132cdb9-b1aa-4c8e-baab-754c1e24ef1c]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:26:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:26:59 devstack sudo[89733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229
Apr 28 02:26:59 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:00 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229" returned: 0 in 0.507s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:00 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5008e232-4a0d-4969-811c-1d07e695ff08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:27:00 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 02:27:00 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Creating direct copy from snapshot {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 02:27:00 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6020c06a-aafe-4b45-ba4c-5e77a6657a31]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:00 devstack sudo[89738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08
Apr 28 02:27:00 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:00 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08" returned: 0 in 0.522s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:00 devstack cinder-volume[81489]: DEBUG cinder.utils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Path /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece not found in is_blk_device check {{(pid=81489) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 02:27:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:00 devstack sudo[89743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece
Apr 28 02:27:00 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:05 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece" returned: 0 in 4.332s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:05 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b13735e-20a8-4a07-9dbb-d0a780a12244]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:05 devstack sudo[89755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08
Apr 28 02:27:05 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:05 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08" returned: 0 in 0.638s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:05 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08, size 1024.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:27:05 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Converted 1024.00 MB image at 236.31 MB/s
Apr 28 02:27:05 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece is being set with open permissions: ugo+rw
Apr 28 02:27:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:05 devstack sudo[89760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece
Apr 28 02:27:05 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:06 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece" returned: 0 in 0.417s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece" released by "_copy_volume_from_snapshot" :: held 6.497s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-quobyte-e23a1fc3-952f-47f1-8123-d34b72096229" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:06 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-e23a1fc3-952f-47f1-8123-d34b72096229" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:06 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Deleting offline snapshot e23a1fc3-952f-47f1-8123-d34b72096229 of volume 5008e232-4a0d-4969-811c-1d07e695ff08 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:27:06 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] snapshot_file for this snap is: volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:27:06 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8f1d88-1f95-4d1a-9302-cbaf99b28093]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:06 devstack sudo[89763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229
Apr 28 02:27:06 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:06 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229" returned: 0 in 0.516s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:06 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5008e232-4a0d-4969-811c-1d07e695ff08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:27:06 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d164122-68ad-41ab-8227-e733e4fb8e28]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:07 devstack sudo[89768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08
Apr 28 02:27:07 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:07 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08" returned: 0 in 0.510s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:07 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:07 devstack sudo[89774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229
Apr 28 02:27:07 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:08 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229" returned: 0 in 0.527s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:08 devstack sudo[89779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229
Apr 28 02:27:08 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:08 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08.e23a1fc3-952f-47f1-8123-d34b72096229" returned: 0 in 0.447s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:08 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-e23a1fc3-952f-47f1-8123-d34b72096229" released by "_delete_snapshot" :: held 2.093s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:08 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.646s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08914c64-c722-4b76-97eb-18d07dc97aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece', 'volume_size': 1, 'source_volid': '5008e232-4a0d-4969-811c-1d07e695ff08', 'source_volstatus': 'available'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1920c81a-8db6-492f-b913-27398deeb3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:08 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Volume volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece (370c2c47-89a0-4a4d-8fdf-e72cd71e4ece): created successfully
Apr 28 02:27:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1920c81a-8db6-492f-b913-27398deeb3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:08 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Flow 'volume_create_manager' (1fe277e9-a51d-48fb-bbdc-054dd9c81217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:08 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ded95644-e180-4569-af81-62cb38b3ff31 tempest-VolumeDependencyTests-1021423530 None] Created volume successfully.
Apr 28 02:27:09 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-5008e232-4a0d-4969-811c-1d07e695ff08-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:09 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-5008e232-4a0d-4969-811c-1d07e695ff08-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:09 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-quobyte-5008e232-4a0d-4969-811c-1d07e695ff08" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:09 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-5008e232-4a0d-4969-811c-1d07e695ff08" acquired by "delete_volume" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:09 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[795526c6-fc23-4de7-8f6e-4677dfaa36b6]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:09 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:09 devstack sudo[89782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08
Apr 28 02:27:09 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:10 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08" returned: 0 in 0.513s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:10 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08
Apr 28 02:27:10 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:10 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-5008e232-4a0d-4969-811c-1d07e695ff08" returned: 0 in 0.421s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:10 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-5008e232-4a0d-4969-811c-1d07e695ff08" released by "delete_volume" :: held 0.994s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:10 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Created reservations ['6ba5c84c-bf29-435d-9dff-1401cbe20e3c', 'fe6dbcd1-b1ab-490b-bca3-69bc81059506', '6c27152a-7472-4a8d-9b74-ac0492d98fb1', '84044e7a-9bae-4167-af40-ce487be89d65'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:10 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:10 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:10 devstack sudo[89790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:10 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:11 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.424s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:11 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:11 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Deleted volume successfully.
Apr 28 02:27:11 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-37ee6482-bc2e-4cc9-81a8-a4123adb7b2a tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-5008e232-4a0d-4969-811c-1d07e695ff08-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:11 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:11 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:11 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-quobyte-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:11 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:11 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ee6679-550d-4106-85a4-b5ef8ece4cc6]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:12 devstack sudo[89793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece
Apr 28 02:27:12 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:12 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece" returned: 0 in 0.502s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:12 devstack sudo[89798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece
Apr 28 02:27:12 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:12 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece" returned: 0 in 0.431s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece" released by "delete_volume" :: held 0.970s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:12 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=69,cinder:INSERT=28,cinder:UPDATE=99,cinder:DELETE=10 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:27:12 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:UPDATE=95,cinder:DELETE=6,cinder:INSERT=21,cinder:SELECT=76 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:27:13 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Created reservations ['748774a8-dc9e-4b56-bdee-e8f023a4be85', '404d6b3e-be59-4dbc-9323-35c40776d2ea', '60ff6b7c-c1ee-4c04-8151-49b16f5d0786', '67bb7ce8-310b-4ed5-a828-d4349811d585'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:13 devstack sudo[89801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:13 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:13 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.432s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:13 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:13 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Deleted volume successfully.
Apr 28 02:27:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-eeee5567-4f14-4d33-94ac-0ace4d12f79f tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-370c2c47-89a0-4a4d-8fdf-e72cd71e4ece-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-2581bc9b-bd87-4248-bf01-e28569fd3028-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-2581bc9b-bd87-4248-bf01-e28569fd3028-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "cinder-quobyte-2581bc9b-bd87-4248-bf01-e28569fd3028" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:14 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-2581bc9b-bd87-4248-bf01-e28569fd3028" acquired by "delete_volume" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:14 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bd67f5-abdf-419b-9d06-0d80daf32fc0]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:14 devstack sudo[89804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028
Apr 28 02:27:14 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:14 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028" returned: 0 in 0.505s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:14 devstack sudo[89809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028
Apr 28 02:27:14 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:15 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2581bc9b-bd87-4248-bf01-e28569fd3028" returned: 0 in 0.433s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-quobyte-2581bc9b-bd87-4248-bf01-e28569fd3028" released by "delete_volume" :: held 0.977s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:15 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Created reservations ['d66950bb-d3d7-45e9-aa76-2a5f033b2aec', '2fbb7aba-d97e-4833-9b3a-fb693a0faefa', '6b558866-e64d-4776-885c-927860d55b39', '089c7b39-8918-492e-b411-95992ddb6db5'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:15 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:15 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:15 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.433s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:15 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:15 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Deleted volume successfully.
Apr 28 02:27:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5cbbfd2d-507a-4508-bbae-1e2319115a00 tempest-VolumeDependencyTests-1021423530 None] Lock "cinder-2581bc9b-bd87-4248-bf01-e28569fd3028-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Flow 'volume_create_manager' (d510ef44-80e7-49c1-94fb-5773f8251045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a0e0c4-3c0a-47c8-b539-33231171a7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a0e0c4-3c0a-47c8-b539-33231171a7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-895225367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a279a05f-e474-4dea-ba09-71f00ee71dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39e6de8ed84a138fdd7ff648df6910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:25Z,use_quota=True,user_id='f18dae3643c24d7fb4fce08fe399e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5097db-ac00-4ead-8921-ab26f85971f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5097db-ac00-4ead-8921-ab26f85971f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4eb926-258f-4512-982d-6e7a4bf1606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c4eb926-258f-4512-982d-6e7a4bf1606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a279a05f-e474-4dea-ba09-71f00ee71dc8', 'volume_name': 'volume-a279a05f-e474-4dea-ba09-71f00ee71dc8', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6f1e52-4c8e-400a-8c8b-e4429b6adcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6f1e52-4c8e-400a-8c8b-e4429b6adcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e137bb-7873-46dc-8994-a7113471736f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:24 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Volume a279a05f-e474-4dea-ba09-71f00ee71dc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a279a05f-e474-4dea-ba09-71f00ee71dc8', 'volume_size': 1}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-895225367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a279a05f-e474-4dea-ba09-71f00ee71dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39e6de8ed84a138fdd7ff648df6910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:25Z,use_quota=True,user_id='f18dae3643c24d7fb4fce08fe399e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Creating volume a279a05f-e474-4dea-ba09-71f00ee71dc8 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:24 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a279a05f-e474-4dea-ba09-71f00ee71dc8 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Flow 'volume_create_manager' (970773a2-64eb-4aa7-898a-bc8f84804b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:24 devstack sudo[89862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a279a05f-e474-4dea-ba09-71f00ee71dc8 1073741824
Apr 28 02:27:24 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad18858-9531-45dc-b321-5fe2e8b05ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bad18858-9531-45dc-b321-5fe2e8b05ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-718479143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba670b2-ccc6-43c8-971f-3b069d3675da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c80b7b500144aebf3f450f44e37fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:25Z,use_quota=True,user_id='ef5f2a77317b4ccc8e2c3633cbda41ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456d2506-8ae6-46af-a4de-43130c4c52d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (456d2506-8ae6-46af-a4de-43130c4c52d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65d70f7-9df8-4b0f-9559-6bfd6e5dff78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65d70f7-9df8-4b0f-9559-6bfd6e5dff78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba670b2-ccc6-43c8-971f-3b069d3675da', 'volume_name': 'volume-4ba670b2-ccc6-43c8-971f-3b069d3675da', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83307c94-ecea-4c44-a300-ae7140e71285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83307c94-ecea-4c44-a300-ae7140e71285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9828f4-1a5a-4fe5-8132-44932b1919c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:24 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Volume 4ba670b2-ccc6-43c8-971f-3b069d3675da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba670b2-ccc6-43c8-971f-3b069d3675da', 'volume_size': 1}
Apr 28 02:27:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Flow 'volume_create_manager' (4feea90f-8e52-44ed-b6c4-00a5ccbc06bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309ddf49-6313-4af4-bfba-520de6a62511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309ddf49-6313-4af4-bfba-520de6a62511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-866994509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc19e91-31b9-498b-941f-b04cd80e9139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed27e6790f4930ad8fbcb05691d9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:25Z,use_quota=True,user_id='8a5af4fdc4f340ed9e8982c1337fb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6573cc-972d-4365-b388-360f855ce6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6573cc-972d-4365-b388-360f855ce6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0ba6df-2841-4dd9-b035-c25a6e62a8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0ba6df-2841-4dd9-b035-c25a6e62a8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bc19e91-31b9-498b-941f-b04cd80e9139', 'volume_name': 'volume-6bc19e91-31b9-498b-941f-b04cd80e9139', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0aa2183-47c6-4d95-8fea-1605103a4a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0aa2183-47c6-4d95-8fea-1605103a4a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb75e151-71ff-4faf-b537-afd1cb0149a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume 6bc19e91-31b9-498b-941f-b04cd80e9139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bc19e91-31b9-498b-941f-b04cd80e9139', 'volume_size': 1}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Flow 'volume_create_manager' (67dcea0e-630d-44c5-9bdc-d2399c0edaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23886a6-97c7-419f-99f6-9b11a7218c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23886a6-97c7-419f-99f6-9b11a7218c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-81932401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc92242-27e6-44f8-95ec-10a1a7016897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39e6de8ed84a138fdd7ff648df6910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:25Z,use_quota=True,user_id='f18dae3643c24d7fb4fce08fe399e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44ae079-d3e0-4ff2-a9a2-bc900d411968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44ae079-d3e0-4ff2-a9a2-bc900d411968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca60bef-7d61-4857-b5d7-fbc90e9ef2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca60bef-7d61-4857-b5d7-fbc90e9ef2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fc92242-27e6-44f8-95ec-10a1a7016897', 'volume_name': 'volume-2fc92242-27e6-44f8-95ec-10a1a7016897', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac9d59f-c75a-4499-a22d-4edf45145f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac9d59f-c75a-4499-a22d-4edf45145f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2132ace-d3f2-4a5a-83e7-41187b150570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Volume 2fc92242-27e6-44f8-95ec-10a1a7016897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fc92242-27e6-44f8-95ec-10a1a7016897', 'volume_size': 1}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Flow 'volume_create_manager' (2ba71781-e8b0-4c0b-9410-9e2d7eeac860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b851cd-a761-4082-9a11-7777de6cf6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b851cd-a761-4082-9a11-7777de6cf6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-87005005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7b587b-326e-4e53-90c6-5e5299d17fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39e6de8ed84a138fdd7ff648df6910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:26Z,use_quota=True,user_id='f18dae3643c24d7fb4fce08fe399e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc877261-d2c8-4fc0-ab14-0799da926b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc877261-d2c8-4fc0-ab14-0799da926b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f74690c-3a8a-414d-b833-20e8eefcddfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f74690c-3a8a-414d-b833-20e8eefcddfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7b587b-326e-4e53-90c6-5e5299d17fa9', 'volume_name': 'volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0bd8f4-28d9-4681-89b5-1ec0e1c8de78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0bd8f4-28d9-4681-89b5-1ec0e1c8de78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bf0642-134b-4e8c-8d8d-e7d11c55ba56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:25 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Volume ae7b587b-326e-4e53-90c6-5e5299d17fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9', 'volume_size': 1}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:25 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a279a05f-e474-4dea-ba09-71f00ee71dc8 1073741824" returned: 0 in 0.938s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:25 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a279a05f-e474-4dea-ba09-71f00ee71dc8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:25 devstack sudo[89867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a279a05f-e474-4dea-ba09-71f00ee71dc8
Apr 28 02:27:25 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Flow 'volume_create_manager' (f98ceaad-59a9-4253-b5c7-feebc72d4bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537abede-7d23-474c-bd18-e60110f142da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537abede-7d23-474c-bd18-e60110f142da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-885681459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5bc6777-18f6-4eda-986a-c1e8561b4bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39e6de8ed84a138fdd7ff648df6910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:26Z,use_quota=True,user_id='f18dae3643c24d7fb4fce08fe399e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae077fb-c8ee-4b8e-9633-ce69ee510ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae077fb-c8ee-4b8e-9633-ce69ee510ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3163fdc7-db91-4a9d-a3f8-bba3baa04e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3163fdc7-db91-4a9d-a3f8-bba3baa04e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5bc6777-18f6-4eda-986a-c1e8561b4bd8', 'volume_name': 'volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e7a762-c2b7-4236-a5c0-f96a0ea1fef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e7a762-c2b7-4236-a5c0-f96a0ea1fef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b5b647-1b07-466b-9b96-7ccf5140af3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:26 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Volume c5bc6777-18f6-4eda-986a-c1e8561b4bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8', 'volume_size': 1}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Flow 'volume_create_manager' (9ec6346f-fb69-40c7-b360-021cedcfc864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bff2d67-edff-4bdd-b4fe-90f0228c1cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bff2d67-edff-4bdd-b4fe-90f0228c1cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-199818752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58b00f7-6c7a-4d2b-afaf-f245d358cec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39e6de8ed84a138fdd7ff648df6910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:26Z,use_quota=True,user_id='f18dae3643c24d7fb4fce08fe399e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbd54f1-58ea-41c1-9505-725c10762f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fbd54f1-58ea-41c1-9505-725c10762f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915c60da-fb35-44d4-8909-dbb00af9d55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915c60da-fb35-44d4-8909-dbb00af9d55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a58b00f7-6c7a-4d2b-afaf-f245d358cec0', 'volume_name': 'volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6adc5c-b56d-4cd7-9d4b-8f832351b48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6adc5c-b56d-4cd7-9d4b-8f832351b48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b822dd51-fe14-4d94-8471-c9b757546591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:26 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Volume a58b00f7-6c7a-4d2b-afaf-f245d358cec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0', 'volume_size': 1}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:26 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a279a05f-e474-4dea-ba09-71f00ee71dc8" returned: 0 in 0.548s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.412s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-718479143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba670b2-ccc6-43c8-971f-3b069d3675da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c80b7b500144aebf3f450f44e37fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:25Z,use_quota=True,user_id='ef5f2a77317b4ccc8e2c3633cbda41ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Creating volume 4ba670b2-ccc6-43c8-971f-3b069d3675da {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:26 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e137bb-7873-46dc-8994-a7113471736f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a279a05f-e474-4dea-ba09-71f00ee71dc8', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35752853-4137-42ef-9d3b-d6bf0c3189d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:26 devstack sudo[89870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da 1073741824
Apr 28 02:27:26 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:26 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Volume volume-a279a05f-e474-4dea-ba09-71f00ee71dc8 (a279a05f-e474-4dea-ba09-71f00ee71dc8): created successfully
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35752853-4137-42ef-9d3b-d6bf0c3189d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:26 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Flow 'volume_create_manager' (d510ef44-80e7-49c1-94fb-5773f8251045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:26 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-04b5a257-39ca-4ad0-a997-a52b8f1dd073 tempest-CreateVolumesFromImageTest-1094363441 None] Created volume successfully.
Apr 28 02:27:27 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da 1073741824" returned: 0 in 0.685s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:27 devstack sudo[89875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da
Apr 28 02:27:27 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:27 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da" returned: 0 in 0.507s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.303s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-866994509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc19e91-31b9-498b-941f-b04cd80e9139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed27e6790f4930ad8fbcb05691d9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:25Z,use_quota=True,user_id='8a5af4fdc4f340ed9e8982c1337fb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Creating volume 6bc19e91-31b9-498b-941f-b04cd80e9139 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:27 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-6bc19e91-31b9-498b-941f-b04cd80e9139 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9828f4-1a5a-4fe5-8132-44932b1919c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba670b2-ccc6-43c8-971f-3b069d3675da', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bf37e9-257d-4a88-bf1a-c5ef7b6dcb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:27 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Volume volume-4ba670b2-ccc6-43c8-971f-3b069d3675da (4ba670b2-ccc6-43c8-971f-3b069d3675da): created successfully
Apr 28 02:27:27 devstack sudo[89879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-6bc19e91-31b9-498b-941f-b04cd80e9139 1073741824
Apr 28 02:27:27 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9bf37e9-257d-4a88-bf1a-c5ef7b6dcb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:27 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Flow 'volume_create_manager' (970773a2-64eb-4aa7-898a-bc8f84804b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:27 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-60cdf8a3-debe-4dcc-803a-f74ee2899014 tempest-VolumeDependencyTests-1567423678 None] Created volume successfully.
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:28 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-6bc19e91-31b9-498b-941f-b04cd80e9139 1073741824" returned: 0 in 0.718s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-6bc19e91-31b9-498b-941f-b04cd80e9139 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:28 devstack sudo[89887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-6bc19e91-31b9-498b-941f-b04cd80e9139
Apr 28 02:27:28 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:28 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-6bc19e91-31b9-498b-941f-b04cd80e9139" returned: 0 in 0.548s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.486s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-81932401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fc92242-27e6-44f8-95ec-10a1a7016897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39e6de8ed84a138fdd7ff648df6910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:25Z,use_quota=True,user_id='f18dae3643c24d7fb4fce08fe399e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Creating volume 2fc92242-27e6-44f8-95ec-10a1a7016897 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:28 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fc92242-27e6-44f8-95ec-10a1a7016897 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb75e151-71ff-4faf-b537-afd1cb0149a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc19e91-31b9-498b-941f-b04cd80e9139', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:29 devstack sudo[89890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fc92242-27e6-44f8-95ec-10a1a7016897 1073741824
Apr 28 02:27:29 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae316b9-cfcc-4727-a399-ab62d9b5b959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:29 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume volume-6bc19e91-31b9-498b-941f-b04cd80e9139 (6bc19e91-31b9-498b-941f-b04cd80e9139): created successfully
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae316b9-cfcc-4727-a399-ab62d9b5b959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Flow 'volume_create_manager' (4feea90f-8e52-44ed-b6c4-00a5ccbc06bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:29 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f75b7f14-777b-4472-ab22-c35876331cc6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Created volume successfully.
Apr 28 02:27:29 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fc92242-27e6-44f8-95ec-10a1a7016897 1073741824" returned: 0 in 0.851s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Flow 'volume_create_manager' (0a2082d4-5ed0-4214-b731-561abe9cf973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6e9be7-4c2f-487d-bc71-42431074a1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6e9be7-4c2f-487d-bc71-42431074a1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1339931763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c272aa-2f93-4a5e-bb45-8b13160b0dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed27e6790f4930ad8fbcb05691d9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:30Z,use_quota=True,user_id='8a5af4fdc4f340ed9e8982c1337fb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de28c623-a9da-4295-93e0-e8957b1bff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de28c623-a9da-4295-93e0-e8957b1bff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2b17b0-9a24-4753-8979-149ee7019130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2b17b0-9a24-4753-8979-149ee7019130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83c272aa-2f93-4a5e-bb45-8b13160b0dc2', 'volume_name': 'volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54184382-fe38-4da9-a6ac-682b335c65c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54184382-fe38-4da9-a6ac-682b335c65c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c15a0df-37ec-45c6-86a7-b3bbd92734be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:29 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume 83c272aa-2f93-4a5e-bb45-8b13160b0dc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2', 'volume_size': 1}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fc92242-27e6-44f8-95ec-10a1a7016897 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:30 devstack sudo[89895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fc92242-27e6-44f8-95ec-10a1a7016897
Apr 28 02:27:30 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Flow 'volume_create_manager' (867067b9-fda4-4e93-98a0-912ceae49b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91d294b-f9f0-48d6-a141-959de38804ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d91d294b-f9f0-48d6-a141-959de38804ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337823947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a0bb5a-b814-4728-9d22-be3ac93b7768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed27e6790f4930ad8fbcb05691d9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:30Z,use_quota=True,user_id='8a5af4fdc4f340ed9e8982c1337fb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f1b913-2215-4685-a25e-830bcdc841a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f1b913-2215-4685-a25e-830bcdc841a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe78def-c45f-44d9-9e4f-b75679e29c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe78def-c45f-44d9-9e4f-b75679e29c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a0bb5a-b814-4728-9d22-be3ac93b7768', 'volume_name': 'volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce03587-dbff-4ad7-a99b-ff0346d46a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce03587-dbff-4ad7-a99b-ff0346d46a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f43039-00e3-46e6-88e1-2f0e2e95aa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:30 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume d4a0bb5a-b814-4728-9d22-be3ac93b7768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768', 'volume_size': 1}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:30 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Flow 'volume_create_manager' (70bf8579-1c45-4f9b-bc54-b63d76c7be59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02754413-70ef-4151-a316-501a834f51d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02754413-70ef-4151-a316-501a834f51d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1803608461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141e44ed-7e4e-482d-ac39-966a11b09fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed27e6790f4930ad8fbcb05691d9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:31Z,use_quota=True,user_id='8a5af4fdc4f340ed9e8982c1337fb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e82d71-e2de-414d-b359-5466d2180271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e82d71-e2de-414d-b359-5466d2180271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0b1013-a051-4ff6-afdd-19095e2a1c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0b1013-a051-4ff6-afdd-19095e2a1c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141e44ed-7e4e-482d-ac39-966a11b09fd2', 'volume_name': 'volume-141e44ed-7e4e-482d-ac39-966a11b09fd2', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313006ac-06c4-43ac-89b6-88944be3c970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313006ac-06c4-43ac-89b6-88944be3c970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2509fb09-3f46-4f02-87c9-78e8180b0650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:30 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume 141e44ed-7e4e-482d-ac39-966a11b09fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141e44ed-7e4e-482d-ac39-966a11b09fd2', 'volume_size': 1}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fc92242-27e6-44f8-95ec-10a1a7016897" returned: 0 in 0.824s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.064s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-87005005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7b587b-326e-4e53-90c6-5e5299d17fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39e6de8ed84a138fdd7ff648df6910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:26Z,use_quota=True,user_id='f18dae3643c24d7fb4fce08fe399e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Creating volume ae7b587b-326e-4e53-90c6-5e5299d17fa9 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:30 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2132ace-d3f2-4a5a-83e7-41187b150570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fc92242-27e6-44f8-95ec-10a1a7016897', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be5d1b4-8950-435b-94b2-44a37459b3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:30 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Volume volume-2fc92242-27e6-44f8-95ec-10a1a7016897 (2fc92242-27e6-44f8-95ec-10a1a7016897): created successfully
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be5d1b4-8950-435b-94b2-44a37459b3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:30 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Flow 'volume_create_manager' (67dcea0e-630d-44c5-9bdc-d2399c0edaef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:30 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b2917b22-1e42-4d49-a648-6f801bfa72df tempest-CreateVolumesFromImageTest-1094363441 None] Created volume successfully.
Apr 28 02:27:30 devstack sudo[89898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9 1073741824
Apr 28 02:27:30 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Flow 'volume_create_manager' (0ac98985-071f-4709-806c-72b71b6acac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06df25e1-75d3-4a91-a9b7-2df0fc188578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06df25e1-75d3-4a91-a9b7-2df0fc188578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1473402636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07f0f82-f9af-4731-ac80-d3269ae58a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed27e6790f4930ad8fbcb05691d9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:31Z,use_quota=True,user_id='8a5af4fdc4f340ed9e8982c1337fb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80110b5a-8b28-419c-84ce-e23421c6daf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80110b5a-8b28-419c-84ce-e23421c6daf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53c2ea0-7eca-4fd5-b259-148a5e5df3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53c2ea0-7eca-4fd5-b259-148a5e5df3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b07f0f82-f9af-4731-ac80-d3269ae58a32', 'volume_name': 'volume-b07f0f82-f9af-4731-ac80-d3269ae58a32', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df824bfe-cbb3-408e-9648-64f7835c37fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df824bfe-cbb3-408e-9648-64f7835c37fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56aeec36-7ceb-4b00-b575-0baf12fd7547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:31 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume b07f0f82-f9af-4731-ac80-d3269ae58a32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b07f0f82-f9af-4731-ac80-d3269ae58a32', 'volume_size': 1}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Flow 'volume_create_manager' (12a36c6d-b972-4e51-a55d-aba7ba7b2e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349b59bb-5538-4516-a943-e354f173c2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349b59bb-5538-4516-a943-e354f173c2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-999053328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e8c799-dcff-4419-af61-75cc064a0897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed27e6790f4930ad8fbcb05691d9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:31Z,use_quota=True,user_id='8a5af4fdc4f340ed9e8982c1337fb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1faf48e-75ac-4d77-9ff9-795af4be9922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1faf48e-75ac-4d77-9ff9-795af4be9922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a11201-3303-4c94-a618-6ef3b3a381f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a11201-3303-4c94-a618-6ef3b3a381f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e8c799-dcff-4419-af61-75cc064a0897', 'volume_name': 'volume-11e8c799-dcff-4419-af61-75cc064a0897', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b6afe2-7dda-4620-a826-83ea6836a0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b6afe2-7dda-4620-a826-83ea6836a0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f2fee7-ab62-47f3-8f14-e5692f70d8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:31 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume 11e8c799-dcff-4419-af61-75cc064a0897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e8c799-dcff-4419-af61-75cc064a0897', 'volume_size': 1}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:31 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9 1073741824" returned: 0 in 0.834s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:31 devstack sudo[89903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9
Apr 28 02:27:31 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:32 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9" returned: 0 in 0.489s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.029s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-885681459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5bc6777-18f6-4eda-986a-c1e8561b4bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39e6de8ed84a138fdd7ff648df6910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:26Z,use_quota=True,user_id='f18dae3643c24d7fb4fce08fe399e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Creating volume c5bc6777-18f6-4eda-986a-c1e8561b4bd8 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:32 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bf0642-134b-4e8c-8d8d-e7d11c55ba56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:32 devstack sudo[89906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8 1073741824
Apr 28 02:27:32 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b17178-98dd-4c71-8419-897dd7779f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:32 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Volume volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9 (ae7b587b-326e-4e53-90c6-5e5299d17fa9): created successfully
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b17178-98dd-4c71-8419-897dd7779f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:32 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Flow 'volume_create_manager' (2ba71781-e8b0-4c0b-9410-9e2d7eeac860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:32 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-e8521dbb-e671-47f0-83e7-a9d3b09d1421 tempest-CreateVolumesFromImageTest-1094363441 None] Created volume successfully.
Apr 28 02:27:33 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8 1073741824" returned: 0 in 0.869s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:33 devstack sudo[89911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8
Apr 28 02:27:33 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:33 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8" returned: 0 in 0.538s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.238s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-199818752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58b00f7-6c7a-4d2b-afaf-f245d358cec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b39e6de8ed84a138fdd7ff648df6910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:26Z,use_quota=True,user_id='f18dae3643c24d7fb4fce08fe399e06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Creating volume a58b00f7-6c7a-4d2b-afaf-f245d358cec0 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:33 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:33 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0 1073741824
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b5b647-1b07-466b-9b96-7ccf5140af3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:33 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2463e9-1364-4a2a-8664-e3623d03811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:33 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Volume volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8 (c5bc6777-18f6-4eda-986a-c1e8561b4bd8): created successfully
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2463e9-1364-4a2a-8664-e3623d03811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:33 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Flow 'volume_create_manager' (f98ceaad-59a9-4253-b5c7-feebc72d4bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:33 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-77777d45-ad62-42c0-9dce-ea60bc3d891e tempest-CreateVolumesFromImageTest-1094363441 None] Created volume successfully.
Apr 28 02:27:34 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0 1073741824" returned: 0 in 0.692s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:34 devstack sudo[89919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0
Apr 28 02:27:34 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:34 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0" returned: 0 in 0.487s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:34 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.683s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b822dd51-fe14-4d94-8471-c9b757546591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb4da60-3821-48a3-9d9c-f9c0de172fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:34 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] Creating offline snapshot 1d0e82f0-f0f1-4047-9a98-db73e3476ae5 of volume 4ba670b2-ccc6-43c8-971f-3b069d3675da {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:27:34 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Volume volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0 (a58b00f7-6c7a-4d2b-afaf-f245d358cec0): created successfully
Apr 28 02:27:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb4da60-3821-48a3-9d9c-f9c0de172fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Flow 'volume_create_manager' (9ec6346f-fb69-40c7-b360-021cedcfc864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:34 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[49371e29-9cc2-4b0e-8265-5451a047f4d8]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:34 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-cb244564-c0cd-4f18-863b-6ca5bd8fc73a tempest-CreateVolumesFromImageTest-1094363441 None] Created volume successfully.
Apr 28 02:27:35 devstack sudo[89922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da
Apr 28 02:27:35 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "cinder-a58b00f7-6c7a-4d2b-afaf-f245d358cec0-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-a58b00f7-6c7a-4d2b-afaf-f245d358cec0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "cinder-quobyte-a58b00f7-6c7a-4d2b-afaf-f245d358cec0" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-quobyte-a58b00f7-6c7a-4d2b-afaf-f245d358cec0" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:35 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4125b3ca-5d4d-4f1c-b5fa-3f030b37293f]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:35 devstack sudo[89924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0
Apr 28 02:27:35 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:35 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da" returned: 0 in 0.689s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:35 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5 1G
Apr 28 02:27:35 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:36 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0" returned: 0 in 0.659s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:36 devstack sudo[89936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0
Apr 28 02:27:36 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:36 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5 1G" returned: 0 in 0.627s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba670b2-ccc6-43c8-971f-3b069d3675da -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:36 devstack sudo[89939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba670b2-ccc6-43c8-971f-3b069d3675da -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5
Apr 28 02:27:36 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:36 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a58b00f7-6c7a-4d2b-afaf-f245d358cec0" returned: 0 in 0.532s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-quobyte-a58b00f7-6c7a-4d2b-afaf-f245d358cec0" released by "delete_volume" :: held 1.242s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Created reservations ['3d174cae-e594-4563-b196-396bc5233d3b', '1d4ccd6b-7905-4265-84a6-654961395a32', '30c80046-df22-4921-9028-1a5fd32756c2', '24f04dc2-624e-4b25-84e2-ec7a8197b3ee'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:36 devstack sudo[89945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:36 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:36 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba670b2-ccc6-43c8-971f-3b069d3675da -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5" returned: 0 in 0.586s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:36 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5 is being set with open permissions: ugo+rw
Apr 28 02:27:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:36 devstack sudo[89947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5
Apr 28 02:27:36 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:37 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.478s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:37 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:37 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Deleted volume successfully.
Apr 28 02:27:37 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4e9b30cc-4820-4461-97b2-406c5a333722 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-a58b00f7-6c7a-4d2b-afaf-f245d358cec0-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:37 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5" returned: 0 in 0.506s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:37 devstack sudo[89952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.info
Apr 28 02:27:37 devstack sudo[89952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:37 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "cinder-c5bc6777-18f6-4eda-986a-c1e8561b4bd8-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:37 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-c5bc6777-18f6-4eda-986a-c1e8561b4bd8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:37 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "cinder-quobyte-c5bc6777-18f6-4eda-986a-c1e8561b4bd8" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:37 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-quobyte-c5bc6777-18f6-4eda-986a-c1e8561b4bd8" acquired by "delete_volume" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:37 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83bd24f-7ea4-41f3-8526-b81209c5b741]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:37 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8
Apr 28 02:27:37 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:37 devstack sudo[89952]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.info" returned: 0 in 0.631s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:37 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.info is being set with open permissions: ugo+rw
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:38 devstack sudo[89958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.info
Apr 28 02:27:38 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:38 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8" returned: 0 in 0.732s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:38 devstack sudo[89963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8
Apr 28 02:27:38 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:38 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.info" returned: 0 in 0.535s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.699s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.590s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1339931763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83c272aa-2f93-4a5e-bb45-8b13160b0dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed27e6790f4930ad8fbcb05691d9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:30Z,use_quota=True,user_id='8a5af4fdc4f340ed9e8982c1337fb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Creating volume 83c272aa-2f93-4a5e-bb45-8b13160b0dc2 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:38 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:38 devstack sudo[89966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2 1073741824
Apr 28 02:27:38 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:38 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8a1944b9-5f77-464f-8502-d2fc3d3882d1 tempest-VolumeDependencyTests-1567423678 None] Create snapshot completed successfully
Apr 28 02:27:38 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-c5bc6777-18f6-4eda-986a-c1e8561b4bd8" returned: 0 in 0.566s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-quobyte-c5bc6777-18f6-4eda-986a-c1e8561b4bd8" released by "delete_volume" :: held 1.345s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:38 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Created reservations ['b8716fbc-e6c5-497b-aeec-51369babf041', '6d2e9608-2189-453e-9d5b-8edac247255e', '2ea1d764-a8d1-4a88-a230-318c62c5c0d1', '8ff73452-69b9-468b-92d9-6fa9ae300cb3'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:39 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:39 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:39 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2 1073741824" returned: 0 in 0.881s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:39 devstack sudo[89974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2
Apr 28 02:27:39 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "cinder-ae7b587b-326e-4e53-90c6-5e5299d17fa9-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:39 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-ae7b587b-326e-4e53-90c6-5e5299d17fa9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.723s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "cinder-quobyte-ae7b587b-326e-4e53-90c6-5e5299d17fa9" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:39 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Deleted volume successfully.
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-quobyte-ae7b587b-326e-4e53-90c6-5e5299d17fa9" acquired by "delete_volume" :: waited 0.045s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-40b1ce68-5d67-412c-b51f-affbd59dd90e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-c5bc6777-18f6-4eda-986a-c1e8561b4bd8-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddb6a39-ab81-4e74-9414-8ce8bc2417e9]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:40 devstack sudo[89978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9
Apr 28 02:27:40 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:40 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2" returned: 0 in 0.564s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.766s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1337823947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a0bb5a-b814-4728-9d22-be3ac93b7768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed27e6790f4930ad8fbcb05691d9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:30Z,use_quota=True,user_id='8a5af4fdc4f340ed9e8982c1337fb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Creating volume d4a0bb5a-b814-4728-9d22-be3ac93b7768 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:40 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c15a0df-37ec-45c6-86a7-b3bbd92734be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672117cf-dca2-4b30-9a29-36c2756916c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:40 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2 (83c272aa-2f93-4a5e-bb45-8b13160b0dc2): created successfully
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672117cf-dca2-4b30-9a29-36c2756916c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Flow 'volume_create_manager' (0a2082d4-5ed0-4214-b731-561abe9cf973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:40 devstack sudo[89980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768 1073741824
Apr 28 02:27:40 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:40 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-78b4ebe0-d5ac-4bf7-8bff-c9fbc420bc59 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Created volume successfully.
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Flow 'volume_create_manager' (8f711cd7-99dc-46a8-9869-5926dd1c5fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025e80aa-e746-442c-bc77-1ed876a62005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025e80aa-e746-442c-bc77-1ed876a62005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1870332141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df75e84-0907-471d-ae4f-24815fa0f158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c80b7b500144aebf3f450f44e37fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1d0e82f0-f0f1-4047-9a98-db73e3476ae5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:40Z,use_quota=True,user_id='ef5f2a77317b4ccc8e2c3633cbda41ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2d9650-f320-4bbc-a53d-651f6ed87183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a2d9650-f320-4bbc-a53d-651f6ed87183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1d2eba-d9a7-4e18-b7f7-ae1df6bcd0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1d2eba-d9a7-4e18-b7f7-ae1df6bcd0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4df75e84-0907-471d-ae4f-24815fa0f158', 'volume_name': 'volume-4df75e84-0907-471d-ae4f-24815fa0f158', 'volume_size': 1, 'snapshot_id': '1d0e82f0-f0f1-4047-9a98-db73e3476ae5'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cdebd3-df0d-4292-9c4b-67d0b7fe8e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cdebd3-df0d-4292-9c4b-67d0b7fe8e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:40 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b37593d-cbf7-4859-acdb-1e6368861a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:40 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Volume 4df75e84-0907-471d-ae4f-24815fa0f158: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4df75e84-0907-471d-ae4f-24815fa0f158', 'volume_size': 1, 'snapshot_id': '1d0e82f0-f0f1-4047-9a98-db73e3476ae5'}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9" returned: 0 in 0.633s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:40 devstack sudo[89985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9
Apr 28 02:27:40 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:41 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768 1073741824" returned: 0 in 0.900s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:41 devstack sudo[89991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768
Apr 28 02:27:41 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:41 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ae7b587b-326e-4e53-90c6-5e5299d17fa9" returned: 0 in 0.544s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-quobyte-ae7b587b-326e-4e53-90c6-5e5299d17fa9" released by "delete_volume" :: held 1.223s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Created reservations ['8842db63-6af1-4524-a3fe-aebd4badbbbf', 'b3bf6d55-9b9c-4f77-aa22-72d57e8b58b2', 'e58d4910-aa74-4971-926b-3385b0b386bd', '1953b2c7-e26f-42f1-ba31-d1ee13fcd781'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:41 devstack sudo[89993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:41 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:41 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768" returned: 0 in 0.518s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.765s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1803608461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141e44ed-7e4e-482d-ac39-966a11b09fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed27e6790f4930ad8fbcb05691d9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:31Z,use_quota=True,user_id='8a5af4fdc4f340ed9e8982c1337fb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Creating volume 141e44ed-7e4e-482d-ac39-966a11b09fd2 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:41 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-141e44ed-7e4e-482d-ac39-966a11b09fd2 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f43039-00e3-46e6-88e1-2f0e2e95aa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bb7a50-da45-4aa9-89a6-97570de96a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:41 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768 (d4a0bb5a-b814-4728-9d22-be3ac93b7768): created successfully
Apr 28 02:27:41 devstack sudo[89996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-141e44ed-7e4e-482d-ac39-966a11b09fd2 1073741824
Apr 28 02:27:41 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bb7a50-da45-4aa9-89a6-97570de96a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Flow 'volume_create_manager' (867067b9-fda4-4e93-98a0-912ceae49b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:41 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-12aaad5e-032b-484c-b7b1-a23f759685ee tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Created volume successfully.
Apr 28 02:27:41 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.554s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:41 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Deleted volume successfully.
Apr 28 02:27:41 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fdc667af-bc18-4a4b-b7b3-075a011f33d2 tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-ae7b587b-326e-4e53-90c6-5e5299d17fa9-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "cinder-2fc92242-27e6-44f8-95ec-10a1a7016897-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-2fc92242-27e6-44f8-95ec-10a1a7016897-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "cinder-quobyte-2fc92242-27e6-44f8-95ec-10a1a7016897" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-quobyte-2fc92242-27e6-44f8-95ec-10a1a7016897" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a36ad6-ece2-40ef-be4d-d32792d3c954]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fc92242-27e6-44f8-95ec-10a1a7016897 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:42 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-141e44ed-7e4e-482d-ac39-966a11b09fd2 1073741824" returned: 0 in 0.749s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:42 devstack sudo[90002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fc92242-27e6-44f8-95ec-10a1a7016897
Apr 28 02:27:42 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-141e44ed-7e4e-482d-ac39-966a11b09fd2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:42 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-141e44ed-7e4e-482d-ac39-966a11b09fd2
Apr 28 02:27:42 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:42 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fc92242-27e6-44f8-95ec-10a1a7016897" returned: 0 in 0.570s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fc92242-27e6-44f8-95ec-10a1a7016897 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:42 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-141e44ed-7e4e-482d-ac39-966a11b09fd2" returned: 0 in 0.452s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:42 devstack sudo[90010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fc92242-27e6-44f8-95ec-10a1a7016897
Apr 28 02:27:42 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.629s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1473402636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07f0f82-f9af-4731-ac80-d3269ae58a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed27e6790f4930ad8fbcb05691d9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:31Z,use_quota=True,user_id='8a5af4fdc4f340ed9e8982c1337fb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Creating volume b07f0f82-f9af-4731-ac80-d3269ae58a32 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:42 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b07f0f82-f9af-4731-ac80-d3269ae58a32 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:42 devstack sudo[90012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b07f0f82-f9af-4731-ac80-d3269ae58a32 1073741824
Apr 28 02:27:42 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2509fb09-3f46-4f02-87c9-78e8180b0650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141e44ed-7e4e-482d-ac39-966a11b09fd2', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a0a439-84ce-4583-9e8b-e69805c2d0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:42 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume volume-141e44ed-7e4e-482d-ac39-966a11b09fd2 (141e44ed-7e4e-482d-ac39-966a11b09fd2): created successfully
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a0a439-84ce-4583-9e8b-e69805c2d0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:42 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Flow 'volume_create_manager' (70bf8579-1c45-4f9b-bc54-b63d76c7be59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:42 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-73c0b050-fd2c-422d-a65d-907cf2c8c032 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Created volume successfully.
Apr 28 02:27:43 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2fc92242-27e6-44f8-95ec-10a1a7016897" returned: 0 in 0.571s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:43 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-quobyte-2fc92242-27e6-44f8-95ec-10a1a7016897" released by "delete_volume" :: held 1.199s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:43 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Created reservations ['6322baaa-0a60-4d2b-b4d8-df02c634219d', '41412efd-1a0f-4a87-b263-1f586a0b6dd6', '0910d6fb-d67d-4039-a078-4c07a2ce2e04', '6392b72b-2951-4cd9-bff9-8626db674a73'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:43 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:43 devstack sudo[90018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:43 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:43 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b07f0f82-f9af-4731-ac80-d3269ae58a32 1073741824" returned: 0 in 0.804s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b07f0f82-f9af-4731-ac80-d3269ae58a32 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:43 devstack sudo[90020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b07f0f82-f9af-4731-ac80-d3269ae58a32
Apr 28 02:27:43 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:44 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.562s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:44 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Deleted volume successfully.
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-530cefff-fb53-47eb-a503-5c1cf34e961a tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-2fc92242-27e6-44f8-95ec-10a1a7016897-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:44 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b07f0f82-f9af-4731-ac80-d3269ae58a32" returned: 0 in 0.485s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.533s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-999053328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e8c799-dcff-4419-af61-75cc064a0897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ed27e6790f4930ad8fbcb05691d9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:31Z,use_quota=True,user_id='8a5af4fdc4f340ed9e8982c1337fb196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Creating volume 11e8c799-dcff-4419-af61-75cc064a0897 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:44 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11e8c799-dcff-4419-af61-75cc064a0897 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56aeec36-7ceb-4b00-b575-0baf12fd7547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07f0f82-f9af-4731-ac80-d3269ae58a32', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403dbd86-445c-41c0-bc44-44545b43586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:44 devstack sudo[90024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11e8c799-dcff-4419-af61-75cc064a0897 1073741824
Apr 28 02:27:44 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:44 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume volume-b07f0f82-f9af-4731-ac80-d3269ae58a32 (b07f0f82-f9af-4731-ac80-d3269ae58a32): created successfully
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (403dbd86-445c-41c0-bc44-44545b43586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Flow 'volume_create_manager' (0ac98985-071f-4709-806c-72b71b6acac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:44 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-4b80a418-93f2-49a8-99b3-22ab12e3a754 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Created volume successfully.
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "cinder-a279a05f-e474-4dea-ba09-71f00ee71dc8-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-a279a05f-e474-4dea-ba09-71f00ee71dc8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "cinder-quobyte-a279a05f-e474-4dea-ba09-71f00ee71dc8" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-quobyte-a279a05f-e474-4dea-ba09-71f00ee71dc8" acquired by "delete_volume" :: waited 0.030s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e66de46-9930-40ee-8998-45a41ae487fb]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a279a05f-e474-4dea-ba09-71f00ee71dc8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:44 devstack sudo[90026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a279a05f-e474-4dea-ba09-71f00ee71dc8
Apr 28 02:27:44 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:45 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11e8c799-dcff-4419-af61-75cc064a0897 1073741824" returned: 0 in 0.834s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11e8c799-dcff-4419-af61-75cc064a0897 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:45 devstack sudo[90031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11e8c799-dcff-4419-af61-75cc064a0897
Apr 28 02:27:45 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:45 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a279a05f-e474-4dea-ba09-71f00ee71dc8" returned: 0 in 0.714s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a279a05f-e474-4dea-ba09-71f00ee71dc8 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:45 devstack sudo[90036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a279a05f-e474-4dea-ba09-71f00ee71dc8
Apr 28 02:27:45 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:45 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11e8c799-dcff-4419-af61-75cc064a0897" returned: 0 in 0.453s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.901s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-quobyte-1d0e82f0-f0f1-4047-9a98-db73e3476ae5-4df75e84-0907-471d-ae4f-24815fa0f158" by "_create_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12f2fee7-ab62-47f3-8f14-e5692f70d8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e8c799-dcff-4419-af61-75cc064a0897', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6166e322-f889-400f-969d-e6354ff0bb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-1d0e82f0-f0f1-4047-9a98-db73e3476ae5-4df75e84-0907-471d-ae4f-24815fa0f158" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Creating volume 4df75e84-0907-471d-ae4f-24815fa0f158 from snapshot 1d0e82f0-f0f1-4047-9a98-db73e3476ae5 {{(pid=81489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-quobyte-4df75e84-0907-471d-ae4f-24815fa0f158" by "_copy_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:45 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Volume volume-11e8c799-dcff-4419-af61-75cc064a0897 (11e8c799-dcff-4419-af61-75cc064a0897): created successfully
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6166e322-f889-400f-969d-e6354ff0bb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Flow 'volume_create_manager' (12a36c6d-b972-4e51-a55d-aba7ba7b2e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:45 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8eea9c52-fe4d-444e-ae59-c6b1feb68901 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Created volume successfully.
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-4df75e84-0907-471d-ae4f-24815fa0f158" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] snapshot: 1d0e82f0-f0f1-4047-9a98-db73e3476ae5, volume: 4df75e84-0907-471d-ae4f-24815fa0f158,  {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eb2634-2bea-491b-8d43-48bcec873f0d]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "cinder-11e8c799-dcff-4419-af61-75cc064a0897-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-11e8c799-dcff-4419-af61-75cc064a0897-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:45 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Flow 'volume_create_manager' (135ee9ca-cac5-4cc1-a2ee-45d004975f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc96007-1735-4353-8acf-152c65bc5fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:45 devstack sudo[90040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5
Apr 28 02:27:45 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-a279a05f-e474-4dea-ba09-71f00ee71dc8" returned: 0 in 0.605s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc96007-1735-4353-8acf-152c65bc5fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-117679850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb6a324-feca-4913-9251-d0eab0533779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a83aa670144a0ba74516f8da62b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:46Z,use_quota=True,user_id='db3c219870bb4d0b8fc2cec82c0553f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713b6ee3-8be2-43cd-a322-f2bab911962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713b6ee3-8be2-43cd-a322-f2bab911962c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cacf086-989d-455f-b673-607751ddb3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cacf086-989d-455f-b673-607751ddb3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb6a324-feca-4913-9251-d0eab0533779', 'volume_name': 'volume-ebb6a324-feca-4913-9251-d0eab0533779', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6da3dc1-d654-4be9-a0db-80024d0ae489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6da3dc1-d654-4be9-a0db-80024d0ae489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897dd70d-d020-45b1-94bd-b4b11991a71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:45 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Volume ebb6a324-feca-4913-9251-d0eab0533779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb6a324-feca-4913-9251-d0eab0533779', 'volume_size': 1}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-quobyte-a279a05f-e474-4dea-ba09-71f00ee71dc8" released by "delete_volume" :: held 1.415s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "cinder-quobyte-11e8c799-dcff-4419-af61-75cc064a0897" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-quobyte-11e8c799-dcff-4419-af61-75cc064a0897" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd53dbb-5a56-4ad5-9ac5-0deac8f46a36]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11e8c799-dcff-4419-af61-75cc064a0897 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:45 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Created reservations ['14da7252-52ad-4885-b722-87ac5ed08cf3', '7e9cf56e-650c-48fb-8297-97f2f8896f73', '90e322a7-613d-45d5-9841-8e28ffda9ac7', 'aba80f49-6620-4e64-89d0-907db25cff83'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:46 devstack sudo[90042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11e8c799-dcff-4419-af61-75cc064a0897
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:46 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:46 devstack sudo[90044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:46 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:46 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5" returned: 0 in 0.596s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba670b2-ccc6-43c8-971f-3b069d3675da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Creating direct copy from snapshot {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[3268e4d1-d46f-4777-b138-b53f8ad3a289]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:46 devstack sudo[90049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da
Apr 28 02:27:46 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:46 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.445s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:46 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Deleted volume successfully.
Apr 28 02:27:46 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11e8c799-dcff-4419-af61-75cc064a0897" returned: 0 in 0.558s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11e8c799-dcff-4419-af61-75cc064a0897 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-f80c90f2-2d74-46fa-a24f-77e5d2cba91e tempest-CreateVolumesFromImageTest-1094363441 None] Lock "cinder-a279a05f-e474-4dea-ba09-71f00ee71dc8-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:46 devstack sudo[90055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11e8c799-dcff-4419-af61-75cc064a0897
Apr 28 02:27:46 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:46 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da" returned: 0 in 0.671s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG cinder.utils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Path /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158 not found in is_blk_device check {{(pid=81489) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:47 devstack sudo[90061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158
Apr 28 02:27:47 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:47 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-11e8c799-dcff-4419-af61-75cc064a0897" returned: 0 in 0.518s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-quobyte-11e8c799-dcff-4419-af61-75cc064a0897" released by "delete_volume" :: held 1.119s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Created reservations ['1a08d05c-ba5a-4c58-a77c-048a5bf53664', '408b6d78-7635-443b-85bc-f6a6184c24cb', '2a2cb47d-93d2-4b66-861f-0dec4c6fe221', '2dedb509-7eff-4ad2-9853-31673f2c9ca0'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:47 devstack sudo[90064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:47 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:47 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.548s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:47 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Deleted volume successfully.
Apr 28 02:27:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-1e16d420-158b-4219-8fe8-6c0e1aa4756a tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-11e8c799-dcff-4419-af61-75cc064a0897-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "cinder-b07f0f82-f9af-4731-ac80-d3269ae58a32-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-b07f0f82-f9af-4731-ac80-d3269ae58a32-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "cinder-quobyte-b07f0f82-f9af-4731-ac80-d3269ae58a32" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:48 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-quobyte-b07f0f82-f9af-4731-ac80-d3269ae58a32" acquired by "delete_volume" :: waited 0.059s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:48 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c2dda9-fa4d-422e-8e2b-fbdf6901f1b2]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:48 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b07f0f82-f9af-4731-ac80-d3269ae58a32 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:48 devstack sudo[90109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b07f0f82-f9af-4731-ac80-d3269ae58a32
Apr 28 02:27:48 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:49 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b07f0f82-f9af-4731-ac80-d3269ae58a32" returned: 0 in 1.166s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:49 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b07f0f82-f9af-4731-ac80-d3269ae58a32 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:49 devstack sudo[90116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b07f0f82-f9af-4731-ac80-d3269ae58a32
Apr 28 02:27:49 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:50 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b07f0f82-f9af-4731-ac80-d3269ae58a32" returned: 0 in 1.151s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:50 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-quobyte-b07f0f82-f9af-4731-ac80-d3269ae58a32" released by "delete_volume" :: held 2.414s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:50 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Created reservations ['8701d3e0-17ed-4c29-90da-2ed846be49ea', '97b3cbe4-266b-41e1-8120-8a9fad885823', '0ef5ebcb-2af3-4211-b40c-dc86fa0f4b27', '4a96d14d-2cab-4657-9cda-c3a481b3f733'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:50 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:50 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:50 devstack sudo[90119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:50 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Flow 'volume_create_manager' (32a37fb0-6b9f-41b1-85b4-bf0fbcc74f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb24ec49-6bb7-4e29-b1d5-a2c48423c5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb24ec49-6bb7-4e29-b1d5-a2c48423c5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1359808156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5325f4-7b33-41e6-9e23-9d43f37b9272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9618d8f9b74dceafbb40160ca26d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:51Z,use_quota=True,user_id='4293224a130f421fb92dd4cc572cb239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a97412-d0fd-4c62-99aa-97547b2080fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a97412-d0fd-4c62-99aa-97547b2080fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bacea877-e803-4a3d-ae8b-87543a7f98f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bacea877-e803-4a3d-ae8b-87543a7f98f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df5325f4-7b33-41e6-9e23-9d43f37b9272', 'volume_name': 'volume-df5325f4-7b33-41e6-9e23-9d43f37b9272', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490c01dd-a7b6-49bd-99e2-5d087ef05608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490c01dd-a7b6-49bd-99e2-5d087ef05608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832f8061-092a-48ce-ab2b-7f94866895ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:51 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume df5325f4-7b33-41e6-9e23-9d43f37b9272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df5325f4-7b33-41e6-9e23-9d43f37b9272', 'volume_size': 1}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "cinder-141e44ed-7e4e-482d-ac39-966a11b09fd2-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-141e44ed-7e4e-482d-ac39-966a11b09fd2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "cinder-quobyte-141e44ed-7e4e-482d-ac39-966a11b09fd2" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-quobyte-141e44ed-7e4e-482d-ac39-966a11b09fd2" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc8ffc0-6f04-47af-8292-07a185ebf23c]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-141e44ed-7e4e-482d-ac39-966a11b09fd2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:51 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.121s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:51 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:52 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Deleted volume successfully.
Apr 28 02:27:52 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-70ba282d-95f6-4730-84a5-ee8aedc2560d tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-b07f0f82-f9af-4731-ac80-d3269ae58a32-delete_volume" released by "delete_volume" :: held 3.919s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:52 devstack sudo[90122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-141e44ed-7e4e-482d-ac39-966a11b09fd2
Apr 28 02:27:52 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:27:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:52 devstack sudo[90124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:52 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:53 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-141e44ed-7e4e-482d-ac39-966a11b09fd2" returned: 0 in 1.231s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-141e44ed-7e4e-482d-ac39-966a11b09fd2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:53 devstack sudo[90129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-141e44ed-7e4e-482d-ac39-966a11b09fd2
Apr 28 02:27:53 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:53 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158" returned: 0 in 6.225s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[441273f6-b5f6-4935-9bcf-5b06129ca84f]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:53 devstack sudo[90131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da
Apr 28 02:27:53 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:53 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.828s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:53 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-141e44ed-7e4e-482d-ac39-966a11b09fd2" returned: 0 in 0.492s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-quobyte-141e44ed-7e4e-482d-ac39-966a11b09fd2" released by "delete_volume" :: held 1.814s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Created reservations ['b108eee9-14ea-45c3-bbfa-2c176da57990', '1a909723-6385-41f9-9cd5-f3841979cd56', '1b6f3eb9-9e8c-475e-8b60-a19ff6e598bc', '622fbdac-d800-47a7-9a37-7b79889d6362'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:53 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:53 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:53 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da" returned: 0 in 0.669s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158 {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:27:53 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Converted 1024.00 MB image at 164.43 MB/s
Apr 28 02:27:53 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158 is being set with open permissions: ugo+rw
Apr 28 02:27:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:53 devstack sudo[90140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158
Apr 28 02:27:53 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "cinder-d4a0bb5a-b814-4728-9d22-be3ac93b7768-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-d4a0bb5a-b814-4728-9d22-be3ac93b7768-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "cinder-quobyte-d4a0bb5a-b814-4728-9d22-be3ac93b7768" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-quobyte-d4a0bb5a-b814-4728-9d22-be3ac93b7768" acquired by "delete_volume" :: waited 0.031s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dbee81-4dbe-4180-ad58-f20ccab4f785]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:54 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.472s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:54 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Deleted volume successfully.
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b07dc34-8b80-42ee-a32c-912e20c65609 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-141e44ed-7e4e-482d-ac39-966a11b09fd2-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:54 devstack sudo[90143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768
Apr 28 02:27:54 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:54 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158" returned: 0 in 0.483s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-4df75e84-0907-471d-ae4f-24815fa0f158" released by "_copy_volume_from_snapshot" :: held 8.794s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-1d0e82f0-f0f1-4047-9a98-db73e3476ae5-4df75e84-0907-471d-ae4f-24815fa0f158" released by "_create_volume_from_snapshot" :: held 8.866s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.905s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.535s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-117679850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb6a324-feca-4913-9251-d0eab0533779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a83aa670144a0ba74516f8da62b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:46Z,use_quota=True,user_id='db3c219870bb4d0b8fc2cec82c0553f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Creating volume ebb6a324-feca-4913-9251-d0eab0533779 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:54 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:54 devstack sudo[90146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 1073741824
Apr 28 02:27:54 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b37593d-cbf7-4859-acdb-1e6368861a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df75e84-0907-471d-ae4f-24815fa0f158', 'volume_size': 1, 'snapshot_id': '1d0e82f0-f0f1-4047-9a98-db73e3476ae5'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1070fe-1afc-4057-a41b-814273287ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:54 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Volume volume-4df75e84-0907-471d-ae4f-24815fa0f158 (4df75e84-0907-471d-ae4f-24815fa0f158): created successfully
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1070fe-1afc-4057-a41b-814273287ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Flow 'volume_create_manager' (8f711cd7-99dc-46a8-9869-5926dd1c5fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:54 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d2527331-00ae-4847-85ad-1f961be354d4 tempest-VolumeDependencyTests-1567423678 None] Created volume successfully.
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-1d0e82f0-f0f1-4047-9a98-db73e3476ae5-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-1d0e82f0-f0f1-4047-9a98-db73e3476ae5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-quobyte-4ba670b2-ccc6-43c8-971f-3b069d3675da" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-4ba670b2-ccc6-43c8-971f-3b069d3675da" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-quobyte-1d0e82f0-f0f1-4047-9a98-db73e3476ae5" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-1d0e82f0-f0f1-4047-9a98-db73e3476ae5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Deleting offline snapshot 1d0e82f0-f0f1-4047-9a98-db73e3476ae5 of volume 4ba670b2-ccc6-43c8-971f-3b069d3675da {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] snapshot_file for this snap is: volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7d3ad3-8fa6-4202-89fc-7fafcb2f3e5d]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:54 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768" returned: 0 in 0.581s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:54 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:54 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5
Apr 28 02:27:54 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:54 devstack sudo[90152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768
Apr 28 02:27:54 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:55 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 1073741824" returned: 0 in 0.658s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:55 devstack sudo[90158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779
Apr 28 02:27:55 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:55 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-d4a0bb5a-b814-4728-9d22-be3ac93b7768" returned: 0 in 0.494s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-quobyte-d4a0bb5a-b814-4728-9d22-be3ac93b7768" released by "delete_volume" :: held 1.116s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:55 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5" returned: 0 in 0.599s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba670b2-ccc6-43c8-971f-3b069d3675da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5576894-5fdd-4f15-aebc-726bc5254ca7]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Created reservations ['7cd151e7-3571-41bd-a6f6-f57af73816f9', '3d759ab3-b51a-48b1-af66-b6bc6e79e935', '7ea47696-fc4d-40a9-b722-97e2bd57c795', '0107eaa8-6822-47c8-8eac-00f1a424d17a'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:55 devstack sudo[90164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da
Apr 28 02:27:55 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:55 devstack sudo[90166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:55 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:55 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779" returned: 0 in 0.496s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.334s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1359808156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df5325f4-7b33-41e6-9e23-9d43f37b9272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9618d8f9b74dceafbb40160ca26d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:27:51Z,use_quota=True,user_id='4293224a130f421fb92dd4cc572cb239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Creating volume df5325f4-7b33-41e6-9e23-9d43f37b9272 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:27:55 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897dd70d-d020-45b1-94bd-b4b11991a71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb6a324-feca-4913-9251-d0eab0533779', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:55 devstack sudo[90169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272 1073741824
Apr 28 02:27:55 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d552f7f0-e1ed-483f-833f-56dccd6814b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:55 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Volume volume-ebb6a324-feca-4913-9251-d0eab0533779 (ebb6a324-feca-4913-9251-d0eab0533779): created successfully
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d552f7f0-e1ed-483f-833f-56dccd6814b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Flow 'volume_create_manager' (135ee9ca-cac5-4cc1-a2ee-45d004975f8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:55 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-70479902-baf3-4448-b0dd-ab2259764352 tempest-SnapshotDependencyTests-1876109736 None] Created volume successfully.
Apr 28 02:27:55 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da" returned: 0 in 0.563s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:55 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.495s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:55 devstack sudo[90175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5
Apr 28 02:27:55 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Deleted volume successfully.
Apr 28 02:27:55 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:55 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d0c4a160-08f9-4dbb-8e12-2c92c39c787e tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-d4a0bb5a-b814-4728-9d22-be3ac93b7768-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:56 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272 1073741824" returned: 0 in 0.629s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "cinder-83c272aa-2f93-4a5e-bb45-8b13160b0dc2-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-83c272aa-2f93-4a5e-bb45-8b13160b0dc2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:56 devstack sudo[90182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272
Apr 28 02:27:56 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "cinder-quobyte-83c272aa-2f93-4a5e-bb45-8b13160b0dc2" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-quobyte-83c272aa-2f93-4a5e-bb45-8b13160b0dc2" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6ded49-9a00-436d-8e6f-20d0e93bd065]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:56 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:56 devstack sudo[90185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2
Apr 28 02:27:56 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5" returned: 0 in 0.587s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:56 devstack sudo[90187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5
Apr 28 02:27:56 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:56 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272" returned: 0 in 0.601s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.034s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832f8061-092a-48ce-ab2b-7f94866895ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df5325f4-7b33-41e6-9e23-9d43f37b9272', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b04314-c7ac-4356-bb04-6ca85c514de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] Creating offline snapshot 48a3084f-030b-4bb2-932f-81a840e37e7f of volume ebb6a324-feca-4913-9251-d0eab0533779 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:27:56 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume volume-df5325f4-7b33-41e6-9e23-9d43f37b9272 (df5325f4-7b33-41e6-9e23-9d43f37b9272): created successfully
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b04314-c7ac-4356-bb04-6ca85c514de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Flow 'volume_create_manager' (32a37fb0-6b9f-41b1-85b4-bf0fbcc74f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f81ff1-7204-4216-bca1-8e1c93967f29]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:56 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:56 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-28c72412-90d4-48af-9dae-6c2c0c31dcce tempest-CreateVolumesFromSnapshotTest-1844162796 None] Created volume successfully.
Apr 28 02:27:57 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2" returned: 0 in 0.606s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:57 devstack sudo[90193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779
Apr 28 02:27:57 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:57 devstack sudo[90195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2
Apr 28 02:27:57 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:57 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da.1d0e82f0-f0f1-4047-9a98-db73e3476ae5" returned: 0 in 0.591s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-1d0e82f0-f0f1-4047-9a98-db73e3476ae5" released by "_delete_snapshot" :: held 2.449s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-4ba670b2-ccc6-43c8-971f-3b069d3675da" released by "delete_snapshot" :: held 2.482s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Created reservations ['d5821fd1-6582-4646-b48b-a52a4e025306', '84d269d8-1357-4331-905b-6e6a781ede50', '87065513-7a5b-4f41-b1be-56cf2195b382', '316eec58-9122-4153-889e-67f35879635a'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:57 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Delete snapshot completed successfully.
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-6149edbc-ada8-4e3f-8460-ac86ee134240 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-1d0e82f0-f0f1-4047-9a98-db73e3476ae5-delete_snapshot" released by "delete_snapshot" :: held 2.617s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:57 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-83c272aa-2f93-4a5e-bb45-8b13160b0dc2" returned: 0 in 0.461s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-quobyte-83c272aa-2f93-4a5e-bb45-8b13160b0dc2" released by "delete_volume" :: held 1.107s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:57 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779" returned: 0 in 0.570s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:57 devstack sudo[90203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f 1G
Apr 28 02:27:57 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Created reservations ['44b5f428-98df-4d44-9300-33782441e681', '6cdfa8e7-4c3f-4d54-b052-ee4f83d9f1f3', '92092112-b5c1-4750-9530-c001dfbff6b6', '87d8b9d9-a1ed-4af4-bef7-0065bae2117b'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:57 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:57 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-4ba670b2-ccc6-43c8-971f-3b069d3675da-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-4ba670b2-ccc6-43c8-971f-3b069d3675da-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-quobyte-4ba670b2-ccc6-43c8-971f-3b069d3675da" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-4ba670b2-ccc6-43c8-971f-3b069d3675da" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f832ce8-a941-4dcf-acc0-f5b38f09e49f]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:57 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:58 devstack sudo[90207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da
Apr 28 02:27:58 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:58 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f 1G" returned: 0 in 0.691s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb6a324-feca-4913-9251-d0eab0533779 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:58 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.586s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:58 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb6a324-feca-4913-9251-d0eab0533779 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f
Apr 28 02:27:58 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:58 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Deleted volume successfully.
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-87e90406-f385-48a2-bc02-607e1d98afa6 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-83c272aa-2f93-4a5e-bb45-8b13160b0dc2-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:58 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da" returned: 0 in 0.558s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:58 devstack sudo[90218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da
Apr 28 02:27:58 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "cinder-6bc19e91-31b9-498b-941f-b04cd80e9139-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-6bc19e91-31b9-498b-941f-b04cd80e9139-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "cinder-quobyte-6bc19e91-31b9-498b-941f-b04cd80e9139" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-quobyte-6bc19e91-31b9-498b-941f-b04cd80e9139" acquired by "delete_volume" :: waited 0.022s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08e6d27-c17c-4fdb-840c-58cb2ad0f622]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-6bc19e91-31b9-498b-941f-b04cd80e9139 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:58 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb6a324-feca-4913-9251-d0eab0533779 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f" returned: 0 in 0.535s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:58 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f is being set with open permissions: ugo+rw
Apr 28 02:27:58 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:58 devstack sudo[90223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-6bc19e91-31b9-498b-941f-b04cd80e9139
Apr 28 02:27:58 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:58 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f
Apr 28 02:27:58 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:59 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4ba670b2-ccc6-43c8-971f-3b069d3675da" returned: 0 in 0.497s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-4ba670b2-ccc6-43c8-971f-3b069d3675da" released by "delete_volume" :: held 1.114s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Created reservations ['e8df8ad6-c738-4b4b-bcec-7c9085c4e90e', '5567a8ab-2c69-428c-8842-22ac3889377e', 'f812b799-faa7-48d1-80f8-5e86ff810e3c', 'c7b6ca82-878f-48b0-a86b-f75627f2b0f9'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:59 devstack sudo[90231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:59 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:59 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f" returned: 0 in 0.485s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:59 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-6bc19e91-31b9-498b-941f-b04cd80e9139" returned: 0 in 0.592s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-6bc19e91-31b9-498b-941f-b04cd80e9139 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:59 devstack sudo[90234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.info
Apr 28 02:27:59 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:59 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-6bc19e91-31b9-498b-941f-b04cd80e9139
Apr 28 02:27:59 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:59 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.447s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:27:59 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Deleted volume successfully.
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-8e1d6775-43c6-4a0a-89c6-7caa2ced3231 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-4ba670b2-ccc6-43c8-971f-3b069d3675da-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:59 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-6bc19e91-31b9-498b-941f-b04cd80e9139" returned: 0 in 0.456s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:59 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-quobyte-6bc19e91-31b9-498b-941f-b04cd80e9139" released by "delete_volume" :: held 1.088s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.info" returned: 0 in 0.490s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:27:59 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.info is being set with open permissions: ugo+rw
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:59 devstack sudo[90241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.info
Apr 28 02:27:59 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Created reservations ['4920c559-5cf0-43f4-9968-93ae94c573de', '78adf54c-2008-4663-b337-f448b4e115fc', '52891582-6a79-4138-9dc8-53d44b851426', '17365de4-97d6-4590-aa1f-857a757078cd'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:27:59 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:27:59 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:27:59 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:00 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.info" returned: 0 in 0.449s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.337s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.421s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Creating offline snapshot 3c58f780-3fd6-4de3-908f-b17beea60185 of volume df5325f4-7b33-41e6-9e23-9d43f37b9272 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:28:00 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-64d60693-81f7-4e05-be78-d67fe730ea94 tempest-SnapshotDependencyTests-1876109736 None] Create snapshot completed successfully
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[74128956-1db2-4438-981b-028a94e93ff1]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:00 devstack sudo[90247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272
Apr 28 02:28:00 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:00 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.498s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:00 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Deleted volume successfully.
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Flow 'volume_create_manager' (7a42c2e1-8953-480e-8164-08a06deb3820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4e6aeb-34b5-4c1d-afa2-d7ae3f924ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-50391346-a809-445e-a72d-79b85642e674 tempest-CreateVolumesFromSourceVolumeTest-1497194591 None] Lock "cinder-6bc19e91-31b9-498b-941f-b04cd80e9139-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4e6aeb-34b5-4c1d-afa2-d7ae3f924ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-261828216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33d9e32-fbb5-439b-a9a4-eeee0736e045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c80b7b500144aebf3f450f44e37fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:00Z,use_quota=True,user_id='ef5f2a77317b4ccc8e2c3633cbda41ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13096fef-bd6e-469d-ab21-320658e0ca02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13096fef-bd6e-469d-ab21-320658e0ca02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0701d87d-4e25-4a62-9fab-0266441eefee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0701d87d-4e25-4a62-9fab-0266441eefee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f33d9e32-fbb5-439b-a9a4-eeee0736e045', 'volume_name': 'volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edea4347-c661-4628-b177-c380cb9f9532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edea4347-c661-4628-b177-c380cb9f9532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb94c546-8593-4e08-83f6-90dca299a096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:00 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Volume f33d9e32-fbb5-439b-a9a4-eeee0736e045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045', 'volume_size': 1}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:00 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272" returned: 0 in 0.558s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:00 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:00 devstack sudo[90252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185 1G
Apr 28 02:28:00 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:28:01 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Flow 'volume_create_manager' (7b9fa83e-0531-4a4f-90c4-bc1b54e98057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb760cd-ce34-40e0-acf4-0f1a782f6f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185 1G" returned: 0 in 0.803s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df5325f4-7b33-41e6-9e23-9d43f37b9272 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb760cd-ce34-40e0-acf4-0f1a782f6f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0db538-dcdc-4fdd-b101-762eaf2f86f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='200a83aa670144a0ba74516f8da62b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=48a3084f-030b-4bb2-932f-81a840e37e7f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:02Z,use_quota=True,user_id='db3c219870bb4d0b8fc2cec82c0553f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:01 devstack sudo[90257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df5325f4-7b33-41e6-9e23-9d43f37b9272 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185
Apr 28 02:28:01 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc24d143-7621-469c-b4f3-082022afe18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc24d143-7621-469c-b4f3-082022afe18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df704971-6741-408a-8e37-cff0e5788c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df704971-6741-408a-8e37-cff0e5788c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1d0db538-dcdc-4fdd-b101-762eaf2f86f3', 'volume_name': 'volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3', 'volume_size': 1, 'snapshot_id': '48a3084f-030b-4bb2-932f-81a840e37e7f'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197f0c9d-f842-464b-b6e0-4ca5f3de358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197f0c9d-f842-464b-b6e0-4ca5f3de358f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c25d06-b624-42a6-81f3-4e05fa7d077a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:01 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Volume 1d0db538-dcdc-4fdd-b101-762eaf2f86f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3', 'volume_size': 1, 'snapshot_id': '48a3084f-030b-4bb2-932f-81a840e37e7f'}
Apr 28 02:28:01 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:02 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df5325f4-7b33-41e6-9e23-9d43f37b9272 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185" returned: 0 in 0.565s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:02 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185 is being set with open permissions: ugo+rw
Apr 28 02:28:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:02 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185
Apr 28 02:28:02 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:02 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185" returned: 0 in 0.497s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:02 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:02 devstack sudo[90265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.info
Apr 28 02:28:02 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:03 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.info" returned: 0 in 0.454s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:03 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.info is being set with open permissions: ugo+rw
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:03 devstack sudo[90268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.info
Apr 28 02:28:03 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Flow 'volume_create_manager' (fdb583f4-1a13-478d-8665-fd41faba5098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968c8d03-2d64-48f7-89d1-7f08118ad167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968c8d03-2d64-48f7-89d1-7f08118ad167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d83222-2756-4607-a670-610103af3908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4767d941151e4a71b92d9b9eacd0dd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:03Z,use_quota=True,user_id='44e17ca28bbe44f9ab267c682237d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482d972d-14f6-42c2-bc57-d9d5ce1e05eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482d972d-14f6-42c2-bc57-d9d5ce1e05eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411c9118-3810-4fbe-8d45-ba82ea48182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411c9118-3810-4fbe-8d45-ba82ea48182e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d83222-2756-4607-a670-610103af3908', 'volume_name': 'volume-51d83222-2756-4607-a670-610103af3908', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061b39f2-9e0c-4f6a-b367-36d0663e1bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061b39f2-9e0c-4f6a-b367-36d0663e1bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfc6f0d-f845-4f8a-ab06-4fa98c3a54bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:03 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Volume 51d83222-2756-4607-a670-610103af3908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d83222-2756-4607-a670-610103af3908', 'volume_size': 1}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:03 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.info" returned: 0 in 0.476s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.456s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.200s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-261828216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33d9e32-fbb5-439b-a9a4-eeee0736e045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c80b7b500144aebf3f450f44e37fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:00Z,use_quota=True,user_id='ef5f2a77317b4ccc8e2c3633cbda41ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Creating volume f33d9e32-fbb5-439b-a9a4-eeee0736e045 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:28:03 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:28:03 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:03 devstack sudo[90271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 1073741824
Apr 28 02:28:03 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:03 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-070c5117-7c6d-41be-8c29-3c68c6c4a75e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Create snapshot completed successfully
Apr 28 02:28:04 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 1073741824" returned: 0 in 0.655s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Flow 'volume_create_manager' (427295c8-75dd-4385-b1dd-93f406019202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7adc0bda-a1b7-48d4-969b-8ea1a63abacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7adc0bda-a1b7-48d4-969b-8ea1a63abacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1462332864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ffe9193-d75d-4528-8b16-277414aa39e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9618d8f9b74dceafbb40160ca26d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:04Z,use_quota=True,user_id='4293224a130f421fb92dd4cc572cb239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:04 devstack sudo[90276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79271db-16a8-4026-b298-8fae69064fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:04 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79271db-16a8-4026-b298-8fae69064fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8434113f-8e1e-4b2c-9d70-7b972704a903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8434113f-8e1e-4b2c-9d70-7b972704a903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ffe9193-d75d-4528-8b16-277414aa39e9', 'volume_name': 'volume-8ffe9193-d75d-4528-8b16-277414aa39e9', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fa18dc-f1cd-44f1-8276-8c56f59efcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fa18dc-f1cd-44f1-8276-8c56f59efcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9ecb1d-416d-4d3a-983b-c6dd26f16d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:04 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume 8ffe9193-d75d-4528-8b16-277414aa39e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ffe9193-d75d-4528-8b16-277414aa39e9', 'volume_size': 1}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Flow 'volume_create_manager' (889058aa-1366-49b0-ad74-90b456e4ff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea1e5c7-34ab-4ac8-af53-b58aadf24642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea1e5c7-34ab-4ac8-af53-b58aadf24642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-32673686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda2217e-a2cd-47b1-b3ff-473b8680f7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9618d8f9b74dceafbb40160ca26d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:05Z,use_quota=True,user_id='4293224a130f421fb92dd4cc572cb239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0dcd69-0fdf-4420-b535-63ce82b0fe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0dcd69-0fdf-4420-b535-63ce82b0fe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf1b678-cd48-471a-b3d2-ea2d25677f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf1b678-cd48-471a-b3d2-ea2d25677f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bda2217e-a2cd-47b1-b3ff-473b8680f7fe', 'volume_name': 'volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fed795b-4021-479c-9d3c-444758ab82aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fed795b-4021-479c-9d3c-444758ab82aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fb7133-6387-47c2-ae74-325ff4707172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:04 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume bda2217e-a2cd-47b1-b3ff-473b8680f7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe', 'volume_size': 1}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:04 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045" returned: 0 in 0.545s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.267s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:04 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "cinder-quobyte-48a3084f-030b-4bb2-932f-81a840e37e7f-1d0db538-dcdc-4fdd-b101-762eaf2f86f3" by "_create_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb94c546-8593-4e08-83f6-90dca299a096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1267b479-f028-4adc-a4a0-799852e5944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-quobyte-48a3084f-030b-4bb2-932f-81a840e37e7f-1d0db538-dcdc-4fdd-b101-762eaf2f86f3" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Creating volume 1d0db538-dcdc-4fdd-b101-762eaf2f86f3 from snapshot 48a3084f-030b-4bb2-932f-81a840e37e7f {{(pid=81489) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "cinder-quobyte-1d0db538-dcdc-4fdd-b101-762eaf2f86f3" by "_copy_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:05 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Volume volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 (f33d9e32-fbb5-439b-a9a4-eeee0736e045): created successfully
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1267b479-f028-4adc-a4a0-799852e5944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Flow 'volume_create_manager' (7a42c2e1-8953-480e-8164-08a06deb3820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Flow 'volume_create_manager' (355b5c57-cfda-410f-a855-61607b7cd252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6834346-6260-4fc3-8fd2-088ed20b9c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-quobyte-1d0db538-dcdc-4fdd-b101-762eaf2f86f3" acquired by "_copy_volume_from_snapshot" :: waited 0.059s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] snapshot: 48a3084f-030b-4bb2-932f-81a840e37e7f, volume: 1d0db538-dcdc-4fdd-b101-762eaf2f86f3,  {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6834346-6260-4fc3-8fd2-088ed20b9c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889279685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb1636d-b475-455b-b012-37100bcee19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9618d8f9b74dceafbb40160ca26d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:05Z,use_quota=True,user_id='4293224a130f421fb92dd4cc572cb239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3334ca1-2893-4518-ab81-db5bb0c89c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3334ca1-2893-4518-ab81-db5bb0c89c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2acf17-972f-427a-a45f-656a83861304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2acf17-972f-427a-a45f-656a83861304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cb1636d-b475-455b-b012-37100bcee19c', 'volume_name': 'volume-2cb1636d-b475-455b-b012-37100bcee19c', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e964af5a-2638-41f9-ae21-035f5a7f47d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e964af5a-2638-41f9-ae21-035f5a7f47d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a056d7a3-4541-4a91-949e-5970172aeb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume 2cb1636d-b475-455b-b012-37100bcee19c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cb1636d-b475-455b-b012-37100bcee19c', 'volume_size': 1}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:05 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ebe728df-fa9d-4581-8594-55dafa4d28d4 tempest-VolumeDependencyTests-1567423678 None] Created volume successfully.
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd75b47-b2ae-40e8-bf3c-3a5234ec78d2]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:05 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f
Apr 28 02:28:05 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Flow 'volume_create_manager' (bcc998e1-caab-4a8b-b4a8-c56e5c8b44db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91a0b11-16e3-4e7a-a686-bb59d38a0af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91a0b11-16e3-4e7a-a686-bb59d38a0af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1845458019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3049bb0-d38f-4576-ad2f-5713005e077d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9618d8f9b74dceafbb40160ca26d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:05Z,use_quota=True,user_id='4293224a130f421fb92dd4cc572cb239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77449f6b-7e74-4d3d-b57a-ee7a696b17aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77449f6b-7e74-4d3d-b57a-ee7a696b17aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761e2346-6c2a-4987-ba37-fd9a06e34d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761e2346-6c2a-4987-ba37-fd9a06e34d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3049bb0-d38f-4576-ad2f-5713005e077d', 'volume_name': 'volume-e3049bb0-d38f-4576-ad2f-5713005e077d', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2aac71-f385-4ad7-b4de-55ac819b3068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d2aac71-f385-4ad7-b4de-55ac819b3068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a485bc62-1482-4abc-9bcb-90d18c81066c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume e3049bb0-d38f-4576-ad2f-5713005e077d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3049bb0-d38f-4576-ad2f-5713005e077d', 'volume_size': 1}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Flow 'volume_create_manager' (f820ec17-1f04-439c-8f79-4995822336c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62c67fa-a57c-4f2b-8d76-91b7eefb4287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62c67fa-a57c-4f2b-8d76-91b7eefb4287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1186154796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80f44e3-4be2-4044-a098-008a04b0bf40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9618d8f9b74dceafbb40160ca26d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:06Z,use_quota=True,user_id='4293224a130f421fb92dd4cc572cb239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d7df2e-e97e-49f6-8e41-d8e1e5a167a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d7df2e-e97e-49f6-8e41-d8e1e5a167a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7e1190-2df6-4c48-a484-b0767b4dc9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7e1190-2df6-4c48-a484-b0767b4dc9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b80f44e3-4be2-4044-a098-008a04b0bf40', 'volume_name': 'volume-b80f44e3-4be2-4044-a098-008a04b0bf40', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fa6c8b-e4cc-4531-8917-229e65bddbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fa6c8b-e4cc-4531-8917-229e65bddbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4812c243-ac83-437c-99c3-04bac91be00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:05 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume b80f44e3-4be2-4044-a098-008a04b0bf40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b80f44e3-4be2-4044-a098-008a04b0bf40', 'volume_size': 1}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:05 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f" returned: 0 in 0.641s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb6a324-feca-4913-9251-d0eab0533779(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Creating direct copy from snapshot {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[1601c026-15ba-420d-b591-56882e727682]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:05 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:05 devstack sudo[90284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779
Apr 28 02:28:05 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Flow 'volume_create_manager' (9e6d12e5-a72e-465f-9be0-4defbe8329dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312decc2-8a08-4b68-b96a-c32240b3186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312decc2-8a08-4b68-b96a-c32240b3186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-882885928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c80b7b500144aebf3f450f44e37fbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f33d9e32-fbb5-439b-a9a4-eeee0736e045,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:06Z,use_quota=True,user_id='ef5f2a77317b4ccc8e2c3633cbda41ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f856cf5b-f268-4aee-9c38-5b898680761e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f856cf5b-f268-4aee-9c38-5b898680761e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7003027-d7c3-4679-a74f-29db35694fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7003027-d7c3-4679-a74f-29db35694fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e', 'volume_name': 'volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e', 'volume_size': 1, 'source_volid': 'f33d9e32-fbb5-439b-a9a4-eeee0736e045', 'source_volstatus': 'available'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e84b55-538c-4afc-9514-686adcb1af5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e84b55-538c-4afc-9514-686adcb1af5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1ee1cb-1b48-4dd0-beb4-44f113b4f8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:06 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Volume bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e', 'volume_size': 1, 'source_volid': 'f33d9e32-fbb5-439b-a9a4-eeee0736e045', 'source_volstatus': 'available'}
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:06 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779" returned: 0 in 0.542s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG cinder.utils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Path /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3 not found in is_blk_device check {{(pid=81489) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 02:28:06 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:06 devstack sudo[90289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3
Apr 28 02:28:06 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:11 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3" returned: 0 in 4.853s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:11 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1915de-34d6-43c1-ba15-40d689784c47]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:11 devstack sudo[90304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779
Apr 28 02:28:11 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:11 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779" returned: 0 in 0.656s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:11 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3 {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:28:11 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Converted 1024.00 MB image at 210.96 MB/s
Apr 28 02:28:11 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3 is being set with open permissions: ugo+rw
Apr 28 02:28:11 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:11 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3
Apr 28 02:28:11 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:12 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3" returned: 0 in 0.432s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-quobyte-1d0db538-dcdc-4fdd-b101-762eaf2f86f3" released by "_copy_volume_from_snapshot" :: held 7.261s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-quobyte-48a3084f-030b-4bb2-932f-81a840e37e7f-1d0db538-dcdc-4fdd-b101-762eaf2f86f3" released by "_create_volume_from_snapshot" :: held 7.335s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.379s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.953s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d83222-2756-4607-a670-610103af3908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4767d941151e4a71b92d9b9eacd0dd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:03Z,use_quota=True,user_id='44e17ca28bbe44f9ab267c682237d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Creating volume 51d83222-2756-4607-a670-610103af3908 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:28:12 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-51d83222-2756-4607-a670-610103af3908 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:12 devstack sudo[90312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-51d83222-2756-4607-a670-610103af3908 1073741824
Apr 28 02:28:12 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c25d06-b624-42a6-81f3-4e05fa7d077a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3', 'volume_size': 1, 'snapshot_id': '48a3084f-030b-4bb2-932f-81a840e37e7f'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ce44f6-0c56-4325-8ff0-f461dd79e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:12 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Volume volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3 (1d0db538-dcdc-4fdd-b101-762eaf2f86f3): created successfully
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ce44f6-0c56-4325-8ff0-f461dd79e90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:12 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Flow 'volume_create_manager' (7b9fa83e-0531-4a4f-90c4-bc1b54e98057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:12 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-eaa303a3-6744-41b0-85c7-4b7780ab064d tempest-SnapshotDependencyTests-1876109736 None] Created volume successfully.
Apr 28 02:28:13 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-51d83222-2756-4607-a670-610103af3908 1073741824" returned: 0 in 0.628s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:INSERT=36,cinder:UPDATE=181,cinder:SELECT=131,cinder:DELETE=19 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:UPDATE=168,cinder:SELECT=121,cinder:DELETE=15,cinder:INSERT=42 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-51d83222-2756-4607-a670-610103af3908 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:13 devstack sudo[90317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-51d83222-2756-4607-a670-610103af3908
Apr 28 02:28:13 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "cinder-48a3084f-030b-4bb2-932f-81a840e37e7f-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:13 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-51d83222-2756-4607-a670-610103af3908" returned: 0 in 0.427s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-48a3084f-030b-4bb2-932f-81a840e37e7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "cinder-quobyte-ebb6a324-feca-4913-9251-d0eab0533779" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.990s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1462332864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ffe9193-d75d-4528-8b16-277414aa39e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9618d8f9b74dceafbb40160ca26d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:04Z,use_quota=True,user_id='4293224a130f421fb92dd4cc572cb239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Creating volume 8ffe9193-d75d-4528-8b16-277414aa39e9 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:28:13 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8ffe9193-d75d-4528-8b16-277414aa39e9 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:13 devstack sudo[90320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8ffe9193-d75d-4528-8b16-277414aa39e9 1073741824
Apr 28 02:28:13 devstack sudo[90320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfc6f0d-f845-4f8a-ab06-4fa98c3a54bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d83222-2756-4607-a670-610103af3908', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cb515a-57f6-40cd-ac93-c4e6e5e20c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-quobyte-ebb6a324-feca-4913-9251-d0eab0533779" acquired by "delete_snapshot" :: waited 0.059s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "cinder-quobyte-48a3084f-030b-4bb2-932f-81a840e37e7f" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:13 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Volume volume-51d83222-2756-4607-a670-610103af3908 (51d83222-2756-4607-a670-610103af3908): created successfully
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cb515a-57f6-40cd-ac93-c4e6e5e20c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Flow 'volume_create_manager' (fdb583f4-1a13-478d-8665-fd41faba5098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-quobyte-48a3084f-030b-4bb2-932f-81a840e37e7f" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Deleting offline snapshot 48a3084f-030b-4bb2-932f-81a840e37e7f of volume ebb6a324-feca-4913-9251-d0eab0533779 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] snapshot_file for this snap is: volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:28:13 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-1718cd00-158b-47a6-8954-84cc6c93a2d6 tempest-CinderUnicodeTest-176585542 None] Created volume successfully.
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a412389-65db-4450-87d0-9cac77ec2704]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:13 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:13 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f
Apr 28 02:28:13 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:14 devstack sudo[90320]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8ffe9193-d75d-4528-8b16-277414aa39e9 1073741824" returned: 0 in 0.650s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8ffe9193-d75d-4528-8b16-277414aa39e9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:14 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f" returned: 0 in 0.590s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb6a324-feca-4913-9251-d0eab0533779(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:28:14 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8ffe9193-d75d-4528-8b16-277414aa39e9
Apr 28 02:28:14 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[63887f11-85df-4c1d-81e0-885ceae0c34a]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:14 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779
Apr 28 02:28:14 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.flows.manager.create_volume [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81489) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Flow 'volume_create_manager' (47ed698b-6b7a-42e1-b80d-6ee6ce683457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc4d961-997f-4fb7-ae27-a86d6b07f54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc4d961-997f-4fb7-ae27-a86d6b07f54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1845848004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ea0198-68bf-441d-a33b-8aa8140293f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4767d941151e4a71b92d9b9eacd0dd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:14Z,use_quota=True,user_id='44e17ca28bbe44f9ab267c682237d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4049c0-11aa-4b46-9053-18767bc0cd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4049c0-11aa-4b46-9053-18767bc0cd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d22932-7366-49dc-9553-20229d08e46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d22932-7366-49dc-9553-20229d08e46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ea0198-68bf-441d-a33b-8aa8140293f1', 'volume_name': 'volume-e2ea0198-68bf-441d-a33b-8aa8140293f1', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1255a0ba-f12a-4a6e-8ff6-f8ddab4d04a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1255a0ba-f12a-4a6e-8ff6-f8ddab4d04a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c165ca02-4287-49a1-aba9-2d1327def576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:14 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Volume e2ea0198-68bf-441d-a33b-8aa8140293f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ea0198-68bf-441d-a33b-8aa8140293f1', 'volume_size': 1}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:14 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8ffe9193-d75d-4528-8b16-277414aa39e9" returned: 0 in 0.517s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.846s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-32673686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda2217e-a2cd-47b1-b3ff-473b8680f7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9618d8f9b74dceafbb40160ca26d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:05Z,use_quota=True,user_id='4293224a130f421fb92dd4cc572cb239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Creating volume bda2217e-a2cd-47b1-b3ff-473b8680f7fe {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:28:14 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:14 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe 1073741824
Apr 28 02:28:14 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9ecb1d-416d-4d3a-983b-c6dd26f16d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ffe9193-d75d-4528-8b16-277414aa39e9', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77778ce2-a230-480c-aae3-7f7f4ef0f2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:14 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume volume-8ffe9193-d75d-4528-8b16-277414aa39e9 (8ffe9193-d75d-4528-8b16-277414aa39e9): created successfully
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77778ce2-a230-480c-aae3-7f7f4ef0f2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Flow 'volume_create_manager' (427295c8-75dd-4385-b1dd-93f406019202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:14 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-ea8c7549-87f2-40b0-94e2-ab99c9dfa36a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Created volume successfully.
Apr 28 02:28:14 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779" returned: 0 in 0.605s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:14 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:14 devstack sudo[90340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f
Apr 28 02:28:14 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:15 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe 1073741824" returned: 0 in 0.597s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:15 devstack sudo[90348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe
Apr 28 02:28:15 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:15 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f" returned: 0 in 0.583s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:15 devstack sudo[90350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f
Apr 28 02:28:15 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:15 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe" returned: 0 in 0.448s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.661s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-889279685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb1636d-b475-455b-b012-37100bcee19c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9618d8f9b74dceafbb40160ca26d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:05Z,use_quota=True,user_id='4293224a130f421fb92dd4cc572cb239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Creating volume 2cb1636d-b475-455b-b012-37100bcee19c {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:28:15 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2cb1636d-b475-455b-b012-37100bcee19c 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fb7133-6387-47c2-ae74-325ff4707172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:15 devstack sudo[90354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2cb1636d-b475-455b-b012-37100bcee19c 1073741824
Apr 28 02:28:15 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3776d4-3f73-4a79-865e-523692767a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:15 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe (bda2217e-a2cd-47b1-b3ff-473b8680f7fe): created successfully
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3776d4-3f73-4a79-865e-523692767a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Flow 'volume_create_manager' (889058aa-1366-49b0-ad74-90b456e4ff84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:15 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779.48a3084f-030b-4bb2-932f-81a840e37e7f" returned: 0 in 0.456s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:15 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d0855b57-b187-441d-ab33-c6dbd360935f tempest-CreateVolumesFromSnapshotTest-1844162796 None] Created volume successfully.
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-quobyte-48a3084f-030b-4bb2-932f-81a840e37e7f" released by "_delete_snapshot" :: held 2.341s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-quobyte-ebb6a324-feca-4913-9251-d0eab0533779" released by "delete_snapshot" :: held 2.384s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:15 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Created reservations ['2ccb5cb9-a1c5-4965-a6ae-c089f8a6adce', '01401510-f350-4cea-825d-e2cad4eb4d74', '7ba1ac6f-2b47-4b75-a2d3-613e7039232f', 'b3aeee53-ff4b-461e-9378-1c800201bc31'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:16 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Delete snapshot completed successfully.
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d84dcc8e-9536-4570-8a67-b61374a95501 tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-48a3084f-030b-4bb2-932f-81a840e37e7f-delete_snapshot" released by "delete_snapshot" :: held 2.573s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:16 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2cb1636d-b475-455b-b012-37100bcee19c 1073741824" returned: 0 in 0.620s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2cb1636d-b475-455b-b012-37100bcee19c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:16 devstack sudo[90359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2cb1636d-b475-455b-b012-37100bcee19c
Apr 28 02:28:16 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "cinder-ebb6a324-feca-4913-9251-d0eab0533779-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-ebb6a324-feca-4913-9251-d0eab0533779-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "cinder-quobyte-ebb6a324-feca-4913-9251-d0eab0533779" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-quobyte-ebb6a324-feca-4913-9251-d0eab0533779" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44be0dd-5358-43aa-96df-0b583eb2f999]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:16 devstack sudo[90361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779
Apr 28 02:28:16 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:16 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2cb1636d-b475-455b-b012-37100bcee19c" returned: 0 in 0.484s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.525s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1845458019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3049bb0-d38f-4576-ad2f-5713005e077d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9618d8f9b74dceafbb40160ca26d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:05Z,use_quota=True,user_id='4293224a130f421fb92dd4cc572cb239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Creating volume e3049bb0-d38f-4576-ad2f-5713005e077d {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:28:16 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e3049bb0-d38f-4576-ad2f-5713005e077d 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a056d7a3-4541-4a91-949e-5970172aeb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cb1636d-b475-455b-b012-37100bcee19c', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:16 devstack sudo[90365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e3049bb0-d38f-4576-ad2f-5713005e077d 1073741824
Apr 28 02:28:16 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:16 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f52982b-dfa1-47b1-89ab-cc83c2cab2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:17 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume volume-2cb1636d-b475-455b-b012-37100bcee19c (2cb1636d-b475-455b-b012-37100bcee19c): created successfully
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f52982b-dfa1-47b1-89ab-cc83c2cab2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Flow 'volume_create_manager' (355b5c57-cfda-410f-a855-61607b7cd252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:17 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-4e2026ed-f0f3-4b9a-8550-eef28177e99e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Created volume successfully.
Apr 28 02:28:17 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779" returned: 0 in 0.528s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:17 devstack sudo[90371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779
Apr 28 02:28:17 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:17 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e3049bb0-d38f-4576-ad2f-5713005e077d 1073741824" returned: 0 in 0.643s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e3049bb0-d38f-4576-ad2f-5713005e077d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:17 devstack sudo[90376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e3049bb0-d38f-4576-ad2f-5713005e077d
Apr 28 02:28:17 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:17 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-ebb6a324-feca-4913-9251-d0eab0533779" returned: 0 in 0.487s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-quobyte-ebb6a324-feca-4913-9251-d0eab0533779" released by "delete_volume" :: held 1.086s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Created reservations ['b5386016-88bb-4be0-b36e-2245adc73e54', 'bc6407dc-6c38-44f2-b2b8-ee96da6b6df0', '71cc238d-e089-4eb8-a1a8-0985bfcb3333', 'bf42dae8-b57b-4723-be0f-94757676b836'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:17 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:17 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:17 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:18 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e3049bb0-d38f-4576-ad2f-5713005e077d" returned: 0 in 0.472s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.427s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1186154796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80f44e3-4be2-4044-a098-008a04b0bf40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9618d8f9b74dceafbb40160ca26d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:06Z,use_quota=True,user_id='4293224a130f421fb92dd4cc572cb239',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Creating volume b80f44e3-4be2-4044-a098-008a04b0bf40 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:28:18 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b80f44e3-4be2-4044-a098-008a04b0bf40 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a485bc62-1482-4abc-9bcb-90d18c81066c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3049bb0-d38f-4576-ad2f-5713005e077d', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:18 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b80f44e3-4be2-4044-a098-008a04b0bf40 1073741824
Apr 28 02:28:18 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b64d32-2c9c-484d-b947-f7f2183e5bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:18 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume volume-e3049bb0-d38f-4576-ad2f-5713005e077d (e3049bb0-d38f-4576-ad2f-5713005e077d): created successfully
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b64d32-2c9c-484d-b947-f7f2183e5bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Flow 'volume_create_manager' (bcc998e1-caab-4a8b-b4a8-c56e5c8b44db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:18 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b968f8de-66cf-4d1c-b62b-e369a750a25b tempest-CreateVolumesFromSnapshotTest-1844162796 None] Created volume successfully.
Apr 28 02:28:18 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.452s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:18 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Deleted volume successfully.
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4c010b82-556e-4aac-ac36-c44a1e510660 tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-ebb6a324-feca-4913-9251-d0eab0533779-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:18 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b80f44e3-4be2-4044-a098-008a04b0bf40 1073741824" returned: 0 in 0.610s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b80f44e3-4be2-4044-a098-008a04b0bf40 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:18 devstack sudo[90388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b80f44e3-4be2-4044-a098-008a04b0bf40
Apr 28 02:28:18 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "cinder-1d0db538-dcdc-4fdd-b101-762eaf2f86f3-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-1d0db538-dcdc-4fdd-b101-762eaf2f86f3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "cinder-quobyte-1d0db538-dcdc-4fdd-b101-762eaf2f86f3" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-quobyte-1d0db538-dcdc-4fdd-b101-762eaf2f86f3" acquired by "delete_volume" :: waited 0.016s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fa76d3-377e-4e6a-b21c-f689f495d362]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:18 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:19 devstack sudo[90390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3
Apr 28 02:28:19 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:19 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b80f44e3-4be2-4044-a098-008a04b0bf40" returned: 0 in 0.455s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 12.946s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:19 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Cloning volume f33d9e32-fbb5-439b-a9a4-eeee0736e045 to volume bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4812c243-ac83-437c-99c3-04bac91be00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b80f44e3-4be2-4044-a098-008a04b0bf40', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f6fcf7-e5f3-42d2-b222-ec0512fdb9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:19 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Volume volume-b80f44e3-4be2-4044-a098-008a04b0bf40 (b80f44e3-4be2-4044-a098-008a04b0bf40): created successfully
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f6fcf7-e5f3-42d2-b222-ec0512fdb9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Flow 'volume_create_manager' (f820ec17-1f04-439c-8f79-4995822336c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Creating offline snapshot 4b60910e-9093-453c-83a9-b8dcb75b1da5 of volume f33d9e32-fbb5-439b-a9a4-eeee0736e045 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:28:19 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-dcc5e9a7-8280-4840-a7b3-05e03e9811de tempest-CreateVolumesFromSnapshotTest-1844162796 None] Created volume successfully.
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a20bd8d-ba81-40cb-901a-c56de62b7f12]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:19 devstack sudo[90393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045
Apr 28 02:28:19 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:19 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3" returned: 0 in 0.548s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:19 devstack sudo[90398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3
Apr 28 02:28:19 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:19 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045" returned: 0 in 0.524s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:19 devstack sudo[90403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5 1G
Apr 28 02:28:19 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-b80f44e3-4be2-4044-a098-008a04b0bf40-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-b80f44e3-4be2-4044-a098-008a04b0bf40-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:19 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:19 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-1d0db538-dcdc-4fdd-b101-762eaf2f86f3" returned: 0 in 0.465s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-quobyte-1d0db538-dcdc-4fdd-b101-762eaf2f86f3" released by "delete_volume" :: held 1.066s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-quobyte-b80f44e3-4be2-4044-a098-008a04b0bf40" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-b80f44e3-4be2-4044-a098-008a04b0bf40" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe99178-3a13-47af-b11c-1bd60ab2c171]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b80f44e3-4be2-4044-a098-008a04b0bf40 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Created reservations ['5c246e86-e3df-4d84-b94b-d24e193d487e', '5ba3d95c-8729-4aaf-a6a5-a033586ceed0', '327a65b8-99c8-4c4a-ab31-8fb7fae92ae2', '9b407be0-e2bd-4d88-a6ed-3e30164c59c5'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:20 devstack sudo[90406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b80f44e3-4be2-4044-a098-008a04b0bf40
Apr 28 02:28:20 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:20 devstack sudo[90408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:20 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:20 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5 1G" returned: 0 in 0.643s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:20 devstack sudo[90413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5
Apr 28 02:28:20 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:20 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b80f44e3-4be2-4044-a098-008a04b0bf40" returned: 0 in 0.548s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b80f44e3-4be2-4044-a098-008a04b0bf40 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:20 devstack sudo[90419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b80f44e3-4be2-4044-a098-008a04b0bf40
Apr 28 02:28:20 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:20 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.498s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:20 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Deleted volume successfully.
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-430b6006-787d-4ce2-892a-77af73bb2c4a tempest-SnapshotDependencyTests-1876109736 None] Lock "cinder-1d0db538-dcdc-4fdd-b101-762eaf2f86f3-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:20 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5" returned: 0 in 0.486s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:20 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5 is being set with open permissions: ugo+rw
Apr 28 02:28:20 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:20 devstack sudo[90424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5
Apr 28 02:28:20 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:21 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-b80f44e3-4be2-4044-a098-008a04b0bf40" returned: 0 in 0.498s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-b80f44e3-4be2-4044-a098-008a04b0bf40" released by "delete_volume" :: held 1.096s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Created reservations ['06455d07-aaf6-4b42-9443-08461879cf06', '939a53b4-dcbf-4514-8422-9014942e5463', 'fb9c4a2c-f9f5-4be5-ac29-a99b50d3779a', '40299912-e129-49f7-9d93-2d831b34897a'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:21 devstack sudo[90427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:21 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:21 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5" returned: 0 in 0.469s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:21 devstack sudo[90436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.info
Apr 28 02:28:21 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:21 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.443s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:21 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Deleted volume successfully.
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d9159126-8cc1-4834-b3bd-fa68ef9d240d tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-b80f44e3-4be2-4044-a098-008a04b0bf40-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:21 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.info" returned: 0 in 0.522s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:21 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.info is being set with open permissions: ugo+rw
Apr 28 02:28:21 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:21 devstack sudo[90441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.info
Apr 28 02:28:21 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-e3049bb0-d38f-4576-ad2f-5713005e077d-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-e3049bb0-d38f-4576-ad2f-5713005e077d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-quobyte-e3049bb0-d38f-4576-ad2f-5713005e077d" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-e3049bb0-d38f-4576-ad2f-5713005e077d" acquired by "delete_volume" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[776c1017-128c-465c-87d5-8cea90ac1f7f]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e3049bb0-d38f-4576-ad2f-5713005e077d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:22 devstack sudo[90443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e3049bb0-d38f-4576-ad2f-5713005e077d
Apr 28 02:28:22 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:22 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.info" returned: 0 in 0.496s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-quobyte-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e" by "_copy_volume_from_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] snapshot: 4b60910e-9093-453c-83a9-b8dcb75b1da5, volume: bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e,  {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2e44e4-04f7-44b2-911d-0ef0bf7ac5e1]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:22 devstack sudo[90446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5
Apr 28 02:28:22 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:22 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e3049bb0-d38f-4576-ad2f-5713005e077d" returned: 0 in 0.613s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:22 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e3049bb0-d38f-4576-ad2f-5713005e077d {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:22 devstack sudo[90452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e3049bb0-d38f-4576-ad2f-5713005e077d
Apr 28 02:28:22 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:23 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5" returned: 0 in 0.592s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Creating direct copy from snapshot {{(pid=81489) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c263bfd-a7f9-48f7-8064-e9bb8de38148]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:23 devstack sudo[90457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045
Apr 28 02:28:23 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:23 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e3049bb0-d38f-4576-ad2f-5713005e077d" returned: 0 in 0.519s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-e3049bb0-d38f-4576-ad2f-5713005e077d" released by "delete_volume" :: held 1.189s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Created reservations ['9a757485-6892-4deb-a9fe-6e4166d6b2c1', 'db2a933a-1a61-4f15-a711-e0d6b4cf45f9', '21107bc8-997d-4c9a-9775-9f7a1ff0ac98', '4ba14b53-6609-493a-87bf-3c327b14a2c5'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:23 devstack sudo[90460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:23 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:23 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045" returned: 0 in 0.613s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG cinder.utils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Path /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e not found in is_blk_device check {{(pid=81489) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 28 02:28:23 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:23 devstack sudo[90465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e
Apr 28 02:28:23 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:24 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.537s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:24 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:24 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Deleted volume successfully.
Apr 28 02:28:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-c72949d3-b370-41ee-917e-a223aaeabb64 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-e3049bb0-d38f-4576-ad2f-5713005e077d-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-2cb1636d-b475-455b-b012-37100bcee19c-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-2cb1636d-b475-455b-b012-37100bcee19c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-quobyte-2cb1636d-b475-455b-b012-37100bcee19c" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:24 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-2cb1636d-b475-455b-b012-37100bcee19c" acquired by "delete_volume" :: waited 0.041s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:24 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f370d2e-58ec-4286-8f1c-e34b03b90554]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:24 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2cb1636d-b475-455b-b012-37100bcee19c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:24 devstack sudo[90473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2cb1636d-b475-455b-b012-37100bcee19c
Apr 28 02:28:24 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:26 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2cb1636d-b475-455b-b012-37100bcee19c" returned: 0 in 1.771s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:26 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2cb1636d-b475-455b-b012-37100bcee19c {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:26 devstack sudo[90484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2cb1636d-b475-455b-b012-37100bcee19c
Apr 28 02:28:26 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:27 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-2cb1636d-b475-455b-b012-37100bcee19c" returned: 0 in 1.095s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-2cb1636d-b475-455b-b012-37100bcee19c" released by "delete_volume" :: held 2.976s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:27 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Created reservations ['641f98b3-fd9b-4802-ab15-affc62d9dba8', 'd863213f-9e89-4d58-ad0b-979bfde331ab', '41737b39-a0d1-4ebf-bed5-46dadb955b16', '1ebe6a1e-9c20-4213-8172-ff6ad884f2b0'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:27 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:27 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:27 devstack sudo[90491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:27 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:27 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-bda2217e-a2cd-47b1-b3ff-473b8680f7fe-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-bda2217e-a2cd-47b1-b3ff-473b8680f7fe-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-quobyte-bda2217e-a2cd-47b1-b3ff-473b8680f7fe" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:28 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-bda2217e-a2cd-47b1-b3ff-473b8680f7fe" acquired by "delete_volume" :: waited 0.040s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:28 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9442aa-5977-4494-b222-19b5c88e2408]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:28 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:28 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe
Apr 28 02:28:28 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:29 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 1.433s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:29 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:29 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Deleted volume successfully.
Apr 28 02:28:29 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-b4903df8-7cce-49c9-99b1-84f1b975eb77 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-2cb1636d-b475-455b-b012-37100bcee19c-delete_volume" released by "delete_volume" :: held 4.937s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:29 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe" returned: 0 in 1.321s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:29 devstack sudo[90500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe
Apr 28 02:28:29 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:29 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e" returned: 0 in 6.230s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:29 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df6529a-bb10-4506-84a8-602bb408f2dd]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:29 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:30 devstack sudo[90502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045
Apr 28 02:28:30 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:30 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bda2217e-a2cd-47b1-b3ff-473b8680f7fe" returned: 0 in 0.750s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:30 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-bda2217e-a2cd-47b1-b3ff-473b8680f7fe" released by "delete_volume" :: held 2.135s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:30 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Created reservations ['5aa8e928-6b55-48d1-b776-a9f3b486a456', '88c4dcfc-7d68-4152-b7f3-74ee0a42c9ca', '6fb7e7c4-eb02-47d5-97ba-4a4674f42d7c', 'da7774d9-eda9-4e85-a36c-12a21f934cc2'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:30 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:30 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:30 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:30 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045" returned: 0 in 0.790s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:30 devstack cinder-volume[81489]: DEBUG cinder.image.image_utils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Image conversion details: src /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e {{(pid=81489) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 28 02:28:30 devstack cinder-volume[81489]: INFO cinder.image.image_utils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Converted 1024.00 MB image at 164.33 MB/s
Apr 28 02:28:30 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e is being set with open permissions: ugo+rw
Apr 28 02:28:30 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:30 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e
Apr 28 02:28:30 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:31 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.557s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:31 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Deleted volume successfully.
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-a0c6f894-7180-402d-969d-5b1dbfbda0c1 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-bda2217e-a2cd-47b1-b3ff-473b8680f7fe-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:31 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e" returned: 0 in 0.527s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e" released by "_copy_volume_from_snapshot" :: held 8.826s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-quobyte-4b60910e-9093-453c-83a9-b8dcb75b1da5" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-4b60910e-9093-453c-83a9-b8dcb75b1da5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Deleting offline snapshot 4b60910e-9093-453c-83a9-b8dcb75b1da5 of volume f33d9e32-fbb5-439b-a9a4-eeee0736e045 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] snapshot_file for this snap is: volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-8ffe9193-d75d-4528-8b16-277414aa39e9-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[4488d4f1-faea-4dfc-8925-4be315116d0b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-8ffe9193-d75d-4528-8b16-277414aa39e9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-quobyte-8ffe9193-d75d-4528-8b16-277414aa39e9" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-8ffe9193-d75d-4528-8b16-277414aa39e9" acquired by "delete_volume" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:31 devstack sudo[90514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5
Apr 28 02:28:31 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[e947a796-f480-4850-aabf-401a29c80f8b]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:31 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8ffe9193-d75d-4528-8b16-277414aa39e9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:31 devstack sudo[90516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8ffe9193-d75d-4528-8b16-277414aa39e9
Apr 28 02:28:31 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:32 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5" returned: 0 in 0.681s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ea5913-6a50-47bf-823a-9a5cc745245e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:32 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8ffe9193-d75d-4528-8b16-277414aa39e9" returned: 0 in 0.660s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8ffe9193-d75d-4528-8b16-277414aa39e9 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:32 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045
Apr 28 02:28:32 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:32 devstack sudo[90526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8ffe9193-d75d-4528-8b16-277414aa39e9
Apr 28 02:28:32 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:32 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-8ffe9193-d75d-4528-8b16-277414aa39e9" returned: 0 in 0.522s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-8ffe9193-d75d-4528-8b16-277414aa39e9" released by "delete_volume" :: held 1.241s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:32 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045" returned: 0 in 0.649s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Created reservations ['e9c586df-9bfe-4c42-bc73-1ee45488935b', '31bac832-960f-43c0-ae44-5d6894e62a63', '7dcdd809-fc4d-4fd0-b0e0-b47aa7b31892', 'ee67b642-88e6-4eec-aa78-fd8ef305a1b8'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:32 devstack sudo[90533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5
Apr 28 02:28:32 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:32 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:32 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:32 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:33 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.531s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:33 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Deleted volume successfully.
Apr 28 02:28:33 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-fd6bd433-804f-4e5b-aed3-beb98412e891 tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-8ffe9193-d75d-4528-8b16-277414aa39e9-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5" returned: 0 in 0.665s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:33 devstack sudo[90541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5
Apr 28 02:28:33 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-3c58f780-3fd6-4de3-908f-b17beea60185-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-3c58f780-3fd6-4de3-908f-b17beea60185-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-quobyte-df5325f4-7b33-41e6-9e23-9d43f37b9272" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-df5325f4-7b33-41e6-9e23-9d43f37b9272" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-quobyte-3c58f780-3fd6-4de3-908f-b17beea60185" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-3c58f780-3fd6-4de3-908f-b17beea60185" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Deleting offline snapshot 3c58f780-3fd6-4de3-908f-b17beea60185 of volume df5325f4-7b33-41e6-9e23-9d43f37b9272 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] snapshot_file for this snap is: volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33d324d-f175-48ab-8d1e-bc27470b9e68]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:33 devstack sudo[90543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185
Apr 28 02:28:33 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:33 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045.4b60910e-9093-453c-83a9-b8dcb75b1da5" returned: 0 in 0.497s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-4b60910e-9093-453c-83a9-b8dcb75b1da5" released by "_delete_snapshot" :: held 2.602s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.760s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.385s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fd3e9a40eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-28T00:28:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1845848004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ea0198-68bf-441d-a33b-8aa8140293f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4767d941151e4a71b92d9b9eacd0dd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-28T00:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-28T00:28:14Z,use_quota=True,user_id='44e17ca28bbe44f9ab267c682237d7a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef05f8da-4a9b-4508-8a76-ec1bd693825f),volume_type_id=ef05f8da-4a9b-4508-8a76-ec1bd693825f)}" {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Creating volume e2ea0198-68bf-441d-a33b-8aa8140293f1 {{(pid=81489) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Selected osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499 as target Quobyte volume. {{(pid=81489) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 28 02:28:33 devstack cinder-volume[81489]: INFO cinder.volume.drivers.remotefs [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] casted to osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499
Apr 28 02:28:33 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1 1073741824 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:34 devstack sudo[90546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1 1073741824
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1ee1cb-1b48-4dd0-beb4-44f113b4f8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e', 'volume_size': 1, 'source_volid': 'f33d9e32-fbb5-439b-a9a4-eeee0736e045', 'source_volstatus': 'available'}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:34 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53eb85df-a42b-4696-ab56-9fbdfa2dc8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:34 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Volume volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e (bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e): created successfully
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53eb85df-a42b-4696-ab56-9fbdfa2dc8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Flow 'volume_create_manager' (9e6d12e5-a72e-465f-9be0-4defbe8329dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:34 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d387f253-c022-43a8-b2f7-e7ac9e61b24d tempest-VolumeDependencyTests-1567423678 None] Created volume successfully.
Apr 28 02:28:34 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185" returned: 0 in 0.530s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df5325f4-7b33-41e6-9e23-9d43f37b9272(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee093297-8471-4d42-9630-2d789f8b7b37]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:34 devstack sudo[90551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272
Apr 28 02:28:34 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-f33d9e32-fbb5-439b-a9a4-eeee0736e045-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-f33d9e32-fbb5-439b-a9a4-eeee0736e045-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-quobyte-f33d9e32-fbb5-439b-a9a4-eeee0736e045" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-f33d9e32-fbb5-439b-a9a4-eeee0736e045" acquired by "delete_volume" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[94835ee7-b9f1-43ad-87dc-ba7ac0799f13]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:34 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:34 devstack sudo[90556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045
Apr 28 02:28:34 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1 1073741824" returned: 0 in 0.732s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:34 devstack sudo[90561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1
Apr 28 02:28:34 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:34 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272" returned: 0 in 0.550s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:34 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:34 devstack sudo[90563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185
Apr 28 02:28:34 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:35 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045" returned: 0 in 0.534s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:35 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1" returned: 0 in 0.451s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'} {{(pid=81489) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:35 devstack sudo[90571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045
Apr 28 02:28:35 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c165ca02-4287-49a1-aba9-2d1327def576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ea0198-68bf-441d-a33b-8aa8140293f1', 'volume_size': 1}' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab48f34-567d-4197-ba4a-96f3ab7c7665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 28 02:28:35 devstack cinder-volume[81489]: INFO cinder.volume.flows.manager.create_volume [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Volume volume-e2ea0198-68bf-441d-a33b-8aa8140293f1 (e2ea0198-68bf-441d-a33b-8aa8140293f1): created successfully
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab48f34-567d-4197-ba4a-96f3ab7c7665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81489) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Flow 'volume_create_manager' (47ed698b-6b7a-42e1-b80d-6ee6ce683457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81489) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 28 02:28:35 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-6629df5e-6ecd-4ba0-8e01-c405a5986aa0 tempest-CinderUnicodeTest-176585542 None] Created volume successfully.
Apr 28 02:28:35 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185" returned: 0 in 0.545s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:35 devstack sudo[90574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185
Apr 28 02:28:35 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:35 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-f33d9e32-fbb5-439b-a9a4-eeee0736e045" returned: 0 in 0.488s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-f33d9e32-fbb5-439b-a9a4-eeee0736e045" released by "delete_volume" :: held 1.087s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Created reservations ['108bf03e-6d00-413e-afb4-937bc3cbe25d', '6c02802a-0e6e-423e-9f67-e2584e466eeb', 'b319b3bd-52ce-4a3a-ba11-ec64e63a3bde', '20eefc98-f41b-48d6-9546-2cf6258142f9'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:35 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272.3c58f780-3fd6-4de3-908f-b17beea60185" returned: 0 in 0.453s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:35 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:35 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-3c58f780-3fd6-4de3-908f-b17beea60185" released by "_delete_snapshot" :: held 2.189s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-df5325f4-7b33-41e6-9e23-9d43f37b9272" released by "delete_snapshot" :: held 2.217s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Created reservations ['a4dce8fd-293c-4c9c-a0bc-5aab305f228b', '93fd0320-662f-4f14-8079-1a536fe62b8d', '276bedf9-a04f-4ba6-aab6-bb708d2309bd', '24e125e7-0a3c-40f0-8716-58645fc51291'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:35 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Delete snapshot completed successfully.
Apr 28 02:28:35 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-85fcfbfa-5eba-4607-80a1-546aba6fa17e tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-3c58f780-3fd6-4de3-908f-b17beea60185-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:36 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.445s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:36 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Deleted volume successfully.
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-89c9c32d-4d3f-4271-a7c1-85d5bb9e4176 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-f33d9e32-fbb5-439b-a9a4-eeee0736e045-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] Creating offline snapshot 9599057b-8538-4825-9ae8-ebd3924ea7f0 of volume e2ea0198-68bf-441d-a33b-8aa8140293f1 {{(pid=81489) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0a99d1-f572-4855-a183-6b5abef0c03e]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:36 devstack sudo[90581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1
Apr 28 02:28:36 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-quobyte-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e" acquired by "delete_volume" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d4406-ff08-4f8f-bc0d-4b7b45140cc9]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-df5325f4-7b33-41e6-9e23-9d43f37b9272-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-df5325f4-7b33-41e6-9e23-9d43f37b9272-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "cinder-quobyte-df5325f4-7b33-41e6-9e23-9d43f37b9272" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-df5325f4-7b33-41e6-9e23-9d43f37b9272" acquired by "delete_volume" :: waited 0.014s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:36 devstack sudo[90583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e
Apr 28 02:28:36 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0611f62-df03-4cc1-887d-7bbe81c60c79]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:36 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:37 devstack sudo[90585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272
Apr 28 02:28:37 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:37 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1" returned: 0 in 0.568s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0 1G {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:37 devstack sudo[90592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0 1G
Apr 28 02:28:37 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:37 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e" returned: 0 in 0.570s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:37 devstack sudo[90600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e
Apr 28 02:28:37 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:37 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272" returned: 0 in 0.510s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:37 devstack sudo[90602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272
Apr 28 02:28:37 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:37 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0 1G" returned: 0 in 0.644s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ea0198-68bf-441d-a33b-8aa8140293f1 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:37 devstack sudo[90610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ea0198-68bf-441d-a33b-8aa8140293f1 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0
Apr 28 02:28:37 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:37 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:37 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-df5325f4-7b33-41e6-9e23-9d43f37b9272" returned: 0 in 0.429s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e" returned: 0 in 0.510s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e" released by "delete_volume" :: held 1.129s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-quobyte-df5325f4-7b33-41e6-9e23-9d43f37b9272" released by "delete_volume" :: held 1.013s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Created reservations ['121db71f-8913-4b3a-940b-de15b02e63b8', '8cbbe06f-2c26-49ef-a579-0c476f504a67', '747cdc29-6352-470c-a4b1-8c5ab5218652', 'c27b311e-30c9-48c2-8125-06b7b301b6f8'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:37 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Created reservations ['93cd0d89-1863-45a6-a46a-d9587193fe8a', 'b50e6c0d-9444-4e48-a069-eb1980f77768', 'a84a463e-0e4e-4807-b45f-31226b1b0e75', '8b0bb070-207a-4c6c-b7a6-b3f1b389b149'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:38 devstack sudo[90612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:38 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:38 devstack sudo[90614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:38 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:38 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2ea0198-68bf-441d-a33b-8aa8140293f1 -F qcow2 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0" returned: 0 in 0.526s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:38 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0 is being set with open permissions: ugo+rw
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:38 devstack sudo[90619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0
Apr 28 02:28:38 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:38 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.448s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:38 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Deleted volume successfully.
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-d4e3021c-fb22-46b6-b49d-0a9ef2dd190a tempest-CreateVolumesFromSnapshotTest-1844162796 None] Lock "cinder-df5325f4-7b33-41e6-9e23-9d43f37b9272-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:38 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.492s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:38 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Deleted volume successfully.
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-9dc16314-57eb-4d07-9ced-1a744e4a071d tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-bbdaa6c7-48b2-48a8-8dc1-13fdf4a9974e-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:38 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0" returned: 0 in 0.440s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:38 devstack sudo[90624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.info
Apr 28 02:28:38 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-4df75e84-0907-471d-ae4f-24815fa0f158-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:38 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-4df75e84-0907-471d-ae4f-24815fa0f158-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "cinder-quobyte-4df75e84-0907-471d-ae4f-24815fa0f158" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:39 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-4df75e84-0907-471d-ae4f-24815fa0f158" acquired by "delete_volume" :: waited 0.023s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:39 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddb3b15-28bc-49a6-a47f-515433eda318]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:39 devstack sudo[90626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158
Apr 28 02:28:39 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:39 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.info" returned: 0 in 0.508s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:39 devstack cinder-volume[81489]: WARNING cinder.volume.drivers.remotefs [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.info is being set with open permissions: ugo+rw
Apr 28 02:28:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.info {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:39 devstack sudo[90629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.info
Apr 28 02:28:39 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:39 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158" returned: 0 in 0.642s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:39 devstack sudo[90635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158
Apr 28 02:28:39 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:39 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.info" returned: 0 in 0.465s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:39 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.251s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:39 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-bc4df219-72c8-4a9a-a888-5601d6ba5835 tempest-CinderUnicodeTest-176585542 None] Create snapshot completed successfully
Apr 28 02:28:40 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-4df75e84-0907-471d-ae4f-24815fa0f158" returned: 0 in 0.558s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-quobyte-4df75e84-0907-471d-ae4f-24815fa0f158" released by "delete_volume" :: held 1.246s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Created reservations ['6338f447-9bf7-4a3a-95cf-ab1a1a482bf5', 'a35d4202-63d6-440c-95de-8daa796693a4', 'b0b2a801-dba3-4989-ab6a-6b1a5688a61a', '5d4317f8-ac1f-489c-8372-4f510a950bd7'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:40 devstack sudo[90638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:40 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "cinder-9599057b-8538-4825-9ae8-ebd3924ea7f0-delete_snapshot" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-9599057b-8538-4825-9ae8-ebd3924ea7f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "cinder-quobyte-e2ea0198-68bf-441d-a33b-8aa8140293f1" by "delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-quobyte-e2ea0198-68bf-441d-a33b-8aa8140293f1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "cinder-quobyte-9599057b-8538-4825-9ae8-ebd3924ea7f0" by "_delete_snapshot" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-quobyte-9599057b-8538-4825-9ae8-ebd3924ea7f0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Deleting offline snapshot 9599057b-8538-4825-9ae8-ebd3924ea7f0 of volume e2ea0198-68bf-441d-a33b-8aa8140293f1 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] snapshot_file for this snap is: volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0 {{(pid=81489) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bed1e8-e495-4c44-ae1a-26182ece6b00]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:40 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.462s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:40 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Deleted volume successfully.
Apr 28 02:28:40 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-5ba8b51a-7d0a-4b58-a6c8-e2f8e6771483 tempest-VolumeDependencyTests-1567423678 None] Lock "cinder-4df75e84-0907-471d-ae4f-24815fa0f158-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:40 devstack sudo[90641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0
Apr 28 02:28:40 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:41 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0" returned: 0 in 0.556s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:41 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.remotefs [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2ea0198-68bf-441d-a33b-8aa8140293f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81489) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 28 02:28:41 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e215b2-0459-40ef-adb8-6837dd5fb451]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:41 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:41 devstack sudo[90646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1
Apr 28 02:28:41 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:42 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1" returned: 0 in 0.571s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:42 devstack sudo[90651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0
Apr 28 02:28:42 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:42 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0" returned: 0 in 0.588s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:42 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:42 devstack sudo[90656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0
Apr 28 02:28:42 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:43 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:43 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1.9599057b-8538-4825-9ae8-ebd3924ea7f0" returned: 0 in 0.441s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:43 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-quobyte-9599057b-8538-4825-9ae8-ebd3924ea7f0" released by "_delete_snapshot" :: held 2.254s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:43 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-quobyte-e2ea0198-68bf-441d-a33b-8aa8140293f1" released by "delete_snapshot" :: held 2.275s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:43 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Created reservations ['1eabae79-9e8b-4a2f-b79f-48875e44c83f', 'a1d9f44c-660e-487a-8019-0b9061e2fcff', '8b145bff-8169-4233-bd0c-b1ae5384f88f', '17f0a292-c159-4d4c-b529-1a3c9dc0ec7b'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:43 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Delete snapshot completed successfully.
Apr 28 02:28:43 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-3b15fb52-9978-473a-b0f7-fb0df785edf2 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-9599057b-8538-4825-9ae8-ebd3924ea7f0-delete_snapshot" released by "delete_snapshot" :: held 2.454s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:43 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "cinder-e2ea0198-68bf-441d-a33b-8aa8140293f1-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-e2ea0198-68bf-441d-a33b-8aa8140293f1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "cinder-quobyte-e2ea0198-68bf-441d-a33b-8aa8140293f1" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:44 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-quobyte-e2ea0198-68bf-441d-a33b-8aa8140293f1" acquired by "delete_volume" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:44 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[345d2a32-a574-41f4-b72d-eb2f92bdaad7]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:44 devstack sudo[90659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1
Apr 28 02:28:44 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:44 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1" returned: 0 in 0.509s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:44 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:44 devstack sudo[90664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1
Apr 28 02:28:44 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:45 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-e2ea0198-68bf-441d-a33b-8aa8140293f1" returned: 0 in 0.432s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-quobyte-e2ea0198-68bf-441d-a33b-8aa8140293f1" released by "delete_volume" :: held 1.000s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:45 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Created reservations ['f49c22ca-fc14-45a9-be06-abb269c889d9', 'c1a9bb57-a63a-484a-a37d-fab2902e089d', '93520528-c72d-45e9-99ac-f376c79f05b7', '9d102501-30b3-41c4-a630-7c053f42dde5'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:45 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:45 devstack sudo[90667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:45 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:45 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:45 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.439s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:45 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:45 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Deleted volume successfully.
Apr 28 02:28:45 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-4645a0ef-16b1-46a8-b207-2c237b0d08f0 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-e2ea0198-68bf-441d-a33b-8aa8140293f1-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "cinder-51d83222-2756-4607-a670-610103af3908-delete_volume" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-51d83222-2756-4607-a670-610103af3908-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "cinder-quobyte-51d83222-2756-4607-a670-610103af3908" by "delete_volume" {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 28 02:28:46 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-quobyte-51d83222-2756-4607-a670-610103af3908" acquired by "delete_volume" :: waited 0.015s {{(pid=81489) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 28 02:28:46 devstack cinder-volume[81489]: DEBUG oslo.privsep.daemon [-] privsep: reply[490a7a85-57ad-4062-bf73-7f84e533b332]: (4, 'qcow2') {{(pid=82246) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 28 02:28:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-51d83222-2756-4607-a670-610103af3908 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:46 devstack sudo[90670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-51d83222-2756-4607-a670-610103af3908
Apr 28 02:28:46 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:46 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-51d83222-2756-4607-a670-610103af3908" returned: 0 in 0.514s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:46 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-51d83222-2756-4607-a670-610103af3908 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:46 devstack sudo[90675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-51d83222-2756-4607-a670-610103af3908
Apr 28 02:28:46 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:47 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661/volume-51d83222-2756-4607-a670-610103af3908" returned: 0 in 0.444s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-quobyte-51d83222-2756-4607-a670-610103af3908" released by "delete_volume" :: held 1.002s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:47 devstack cinder-volume[81489]: DEBUG cinder.quota [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Created reservations ['54f3729f-fbe4-431c-b981-01a2bd1defee', '3d716a17-f352-4cda-bd44-e919b1c4e63b', 'a24f7c9e-dfb4-416e-b4ac-e3590217628c', '5b99b7f1-4f03-4b0a-a1d2-ce2fa8ef675c'] {{(pid=81489) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 28 02:28:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:47 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:47 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:47 devstack sudo[90679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:47 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:47 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:47 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.432s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:47 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:47 devstack cinder-volume[81489]: INFO cinder.volume.manager [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Deleted volume successfully.
Apr 28 02:28:47 devstack cinder-volume[81489]: DEBUG cinder.coordination [None req-06af9acd-2f93-45e7-9eab-c41591a19756 tempest-CinderUnicodeTest-176585542 None] Lock "cinder-51d83222-2756-4607-a670-610103af3908-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=81489) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 28 02:28:52 devstack cinder-volume[81489]: DEBUG oslo_service.periodic_task [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81489) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 28 02:28:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 28 02:28:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 28 02:28:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499': None} {{(pid=81489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 28 02:28:52 devstack cinder-volume[81489]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-178efdbf-7155-4e77-bba2-484ee07ce499'] {{(pid=81489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 28 02:28:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.lockutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81489) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 28 02:28:52 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661 {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 28 02:28:52 devstack sudo[90720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661
Apr 28 02:28:52 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 28 02:28:53 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root
Apr 28 02:28:53 devstack cinder-volume[81489]: DEBUG oslo_concurrency.processutils [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7f2dffcefb001e1fe431f1d414431661" returned: 0 in 0.425s {{(pid=81489) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 28 02:28:53 devstack cinder-volume[81489]: DEBUG cinder.manager [None req-c9ae8c21-1cc8-4486-9519-215c7fa2c56a None None] Notifying Schedulers of capabilities ... {{(pid=81489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 28 02:28:57 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:SELECT=86,cinder:INSERT=35,cinder:UPDATE=141,cinder:DELETE=8 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 28 02:28:57 devstack cinder-volume[81489]: DEBUG dbcounter [-] [81489] Writing DB stats cinder:UPDATE=147,cinder:DELETE=14,cinder:SELECT=106,cinder:INSERT=40 {{(pid=81489) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}